this post was submitted on 27 May 2024
1100 points (98.0% liked)

Technology

59646 readers
2709 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

You know how Google's new feature called AI Overviews is prone to spitting out wildly incorrect answers to search queries? In one instance, AI Overviews told a user to use glue on pizza to make sure the cheese won't slide off (pssst...please don't do this.)

Well, according to an interview at The Vergewith Google CEO Sundar Pichai published earlier this week, just before criticism of the outputs really took off, these "hallucinations" are an "inherent feature" of  AI large language models (LLM), which is what drives AI Overviews, and this feature "is still an unsolved problem."

you are viewing a single comment's thread
view the rest of the comments
[–] 9488fcea02a9 21 points 6 months ago* (last edited 6 months ago) (3 children)

I hate the AI hype right now, but to say the entire thing should fail is short sighted.

Imagine people saying the following: "The internet is just hype. I get too much spam emails. I hope the entire thing is a catastrophic failure."

Imagine we just shut down the entire internet because the dotcom bubble was full of scams and overhyped....

[–] [email protected] 23 points 6 months ago (2 children)

Honestly the internet has ruined us. Dont threaten me with a good time.

[–] [email protected] 14 points 6 months ago (1 children)

The peak of computer productivity was spreadsheets and smb shares in the '90s everything else has been downhill in terms of increase of distraction and time wasting inefficiencies.

[–] [email protected] 9 points 6 months ago

increase of distraction and time wasting inefficiencies.

Yea fuck having fun

[–] [email protected] 1 points 6 months ago

There is hope! The UK just passed some comprehensive IoT security rules with teeth. An actual win in this megalomaniac capitalists dream of an economy!

[–] [email protected] 13 points 6 months ago (3 children)

The Internet immediately worked, which is one big difference. The dot com financial bubble has nothing to do with the functionality of the internet.

In this case, there is both a financial bubble, and a "product" that doesn't really work, and which they can't make any better (as he admits in this article.)

It was obvious from day 1 how useful the Internet would be. Email alone was revolutionary. We are still trying to figure out what the real uses for LLM are. There appear to be some valid use cases outside of creating spam and plagiarizing other people's work, but it doesn't appear to be any kind of revolutionary technology.

[–] 9488fcea02a9 5 points 6 months ago

"product" that doesn't really work, and which they can't make any better

LLMs "dont work" because people are promising idiotic things and being used recklessly for things they are not good at. This is like saying a chainsaw is a failed product because it's not good at slicing sushi

It was obvious from day 1 how useful the Internet would be. Email alone was revolutionary

Hindsight 20/20. There were a lot of people smarter than you and i predicting that the internet was just a fad

[–] [email protected] 4 points 6 months ago

Summarizing is something that it does very well. Still not 100% but, when using RAG and telling it "don't make shit up" can result in pretty good compute efficiency and results.

[–] brbposting 3 points 6 months ago

There appear to be some valid use cases outside of creating spam and plagiarizing other people's work

Like translation, which has already taken money out of the pockets of 40% of translators?

+ customer service, incl. sources

November 2022: ChatGPT is released

April 2024 survey: 40% of translators have lost income to generative AI - The Guardian

Also of note from the podcast Hard Fork:

There’s a client you would fire… if copywriting jobs weren’t harder to come by these days as well.

Customer service impact, last October:

And this past February - potential 700 employee impact at a single company:

If you’re technical, the tech isn’t as interesting [yet]:

Overall, costs down, capabilities up (neat demos):

Hope everyone reading this keeps up their skillsets and fights for Universal Basic Income for the rest of humanity :)

[–] [email protected] 4 points 6 months ago (3 children)

Genuinely curious, what pieces do you suggest we can keep from LLM/GenAI/etc?

[–] [email protected] 9 points 6 months ago (1 children)

?

Have you never used any of these tools? They're excellent at doing simple things very fast. But it's like a word processor in the 90s. It's just a tool, not the font of all knowledge.

I guess younger people won't know this, but word processor programs were very impressive when they first came out. They replaced typewriters; a page printed from a printer looked much more professional than even the best typewriters. This lent an air of credibility to anything that was printed from a computer because it was new and expensive.

Think about that now. Do you automatically trust anything that's just printed on a piece of paper? No, because that's stupid. Anyone can just print whatever they want. LLMs are like that now. They can just say whatever they want. It's up to you to make sure it's true.

[–] [email protected] 6 points 6 months ago (1 children)

Font of all knowledge sounds like an excellent font. I assume it's serifed?

[–] [email protected] 3 points 6 months ago (1 children)
[–] [email protected] 3 points 6 months ago

The only good response! 😄

[–] [email protected] 3 points 6 months ago

The main field where they are already actively in professuonal use are rough drafts in creative fields: quickly generate possible outlines for a text, a speech, an art piece. Visualize where something could be going, in order to decide which direction to pick.

Also, models that work differently from the GPTs are already in use in science, scanning through huge amounts of texts in archives to help analyzing or search for something in particular. Help find patterns in things for studies. Etc.

The "personal assistant AI" thing obviously isnt quite working yet. I think it will take some time and models with a different technological structure (not GPT) to achieve progress in that regard.

[–] [email protected] 0 points 6 months ago

Using it to generate things that you double check. Transforming generative work to review work is a boost in productivity. So writing of any kind, art, etc. asking the llm for facts without context is a gross mistake. Prompting it to generate a specific paragraph in a larger, technical or regulator document is useful.