this post was submitted on 27 May 2024
1100 points (98.0% liked)

Technology

59622 readers
2883 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

You know how Google's new feature called AI Overviews is prone to spitting out wildly incorrect answers to search queries? In one instance, AI Overviews told a user to use glue on pizza to make sure the cheese won't slide off (pssst...please don't do this.)

Well, according to an interview at The Vergewith Google CEO Sundar Pichai published earlier this week, just before criticism of the outputs really took off, these "hallucinations" are an "inherent feature" of  AI large language models (LLM), which is what drives AI Overviews, and this feature "is still an unsolved problem."

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 34 points 6 months ago (3 children)

But this is not misinformation, it is uncontrolled nonsense. It directly devalues their offering of being able to provide you with an accurate answer to something you look for. And if their overall offering becomes less valuable, so does their ability to steer you using their results.

So while the incorrect nature is not a problem in itself for them, (as you see from his answer)… the degradation of their ability to influence results is.

[–] [email protected] 8 points 6 months ago (2 children)

But this is not misinformation, it is uncontrolled nonsense.

The strategy is to get you to keep feeding Google new prompts in order to feed you more adds.

The AI response is just a gimmick. It gives Google something to tell their investors, when they get asked "What are you doing with AI right now? We hear that's big."

But the real money is getting unique user interactions for the purpose of serving up more ad content. In that model, bad answers are actually better than no answers, because they force the end use to keep refining the query and searching through the site backlog.

[–] [email protected] 2 points 6 months ago* (last edited 6 months ago)

If you don't know the answer is bad, which confident idiots spouting off on reddit and being upvoted into infinity has proven is common, then you won't refine your search. You'll just accept the bad answer and move on.

Your logic doesn't follow. If someone doesn't know the answer and are searching for it, they likely won't be able to tell if the answer is correct. We literally already have that problem with misinformation. And what sounds more confident than an AI?

[–] [email protected] 1 points 6 months ago (1 children)

I don't believe they will retain user interactions if the reason for the user interactions dissapears. The value of Google is they provide accurate search results.

I can understand some users just want to be spoonfed an answer. But that's not what most people expect from a search engine.

I want google to use actual AI to filter out all the nonsense sites that turn a Reddit post into an article of 500 words using an LLM without any actual value. That should be googles proposition.

[–] [email protected] 1 points 6 months ago

The value of Google is they provide accurate search results.

They offer the most accurate results of search engines you're familiar with. But in a shrinking field with degrading quality, that's a low bar and sinking quick.

I want google to use actual AI to filter out all the nonsense sites

So did the last head of Google search, until the new CEO fired him.

[–] [email protected] 4 points 6 months ago (1 children)

But this is not misinformation, it is uncontrolled nonsense.

Fair enough... but drowning out any honest discourse with a flood of histrionic right-wing horseshit has always been the core strategy of the US propaganda model - I'd say that their AI is just doing the logical thing and taking the horseshit to a very granular level. I mean... "put glue on your pizza" is just not that far off "drink bleach to kill viruses on the inside."

I know I'm describing a pattern that probably wasn't intentional (I hope) - but the pattern does look like it could fit.

[–] [email protected] 3 points 6 months ago

Oh don't get me wrong I know exactly what you mean and I agree.. it's just that the LLMs are spewing actual nonsense and that breaks the whole principle of what a search engine should do.. provide me accurate results.

[–] [email protected] 3 points 6 months ago (1 children)

Google isn’t bothered by incorrect results because search results are no longer their product. Constantly rising stock values are their product now. Hype is their path to those higher values.

[–] [email protected] 2 points 6 months ago

That is actually a really good observation.