"You want a list of spam sites, phishing, malware, and SEO-driven gibberish with back-links?"
Yes, exactly, I want exactly whatever I search for, including that if that's what I search for.
If I search for something which exists, then I want the knowledge of that existence. The value judgement is no one else's business unless I search for "X but only where approved by any governments or companies with any political or financial interest in controlling what I know."
When it turns out that I would never choose to search for that, that is the proof that it's wrong to be doing it.
You don't really get the knowledge of its existence if it's one of thirty million hits. A search engine that includes everything is a kind of Library of Babel. The info is there but it doesn't help you.
There is no reason for legitimate filtering not to be voluntary, like the default porn filter that you have the option to disable.
I still have access to my spam folder, and unsolicited communication is not the same as search results. If I search for something, then I searched for it. I am THE ONLY person who may judge the value of the results.
The search engine's job is only to tell me what's there, not to tell me what I want.
I do want to see those emails. Which is why I run my own mail server where I control what does and does not get rejected. BTW Google and Microsoft do reject or worse, silently drop tons of legitimate mail for such great reasons as the sending server having a bad actor living on the block some time in the past. Mail filtering is a really bad argument why you wouldn't want to see what is hidden from you by the incumbent providers.
Running my own crawler is unfortunately not as realistic.
You can't say that for anyone else. No one can say that for anyone else.
And, repeating, unsolicited communication is different from search results.
But in fact yes I do wish I could trust that my spam folder was actually complete. I find false positives in there all the time. But my point was that even if it's incomplete, you still have a spam folder that you can choose whether to look at or not. The fact that some stuff is filtered by other parties before reaching my client or server is irrelevant.
And you are welcome to it. But don't be surprised that few other people also desire that service, or that no companies are rushing to provide it for you.
Yes, exactly, I want exactly whatever I search for, including that if that's what I search for.
If I search for something which exists, then I want the knowledge of that existence. The value judgement is no one else's business unless I search for "X but only where approved by any governments or companies with any political or financial interest in controlling what I know."
When it turns out that I would never choose to search for that, that is the proof that it's wrong to be doing it.