this post was submitted on 12 Jun 2024
392 points (95.4% liked)
Technology
57472 readers
3626 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
The problem with AI hallucinations is not that the AI was fed inaccurate information, it's that it's coming up with information that it wasn't fed in the first place.
As you say, this is a problem that humans have. But I'm not terribly surprised these AIs have it because they're being built in mimicry of how aspects of the human mind works. And in some cases it's desirable behaviour, for example when you're using an AI as a creative assistant. You want it to come up with new stuff in those situations.
It's just something you need to keep in mind when coming up with applications.
Not in the case of the google search AI. It quotes directly from unreliable sources.
Exactly, which is why I've objected in the past to calling Google Overview's mistakes "hallucinations." The AI itself is performing correctly, it's giving an accurate overview of the search result it's being told to create an overview for. It's just being fed incorrect information.