Technology

59038 readers

3047 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

[email protected]

236

AI models face collapse if they overdose on their own output (www.theregister.com)

submitted 3 months ago by [email protected] to c/[email protected]

25 comments fedilink hide all child comments

Source Nature research paper

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 6 points 3 months ago* (last edited 3 months ago) (1 children)

Thanks for the reply.

I guess we'll see what happens.

I still find it difficult to get my head around how a decrease in novel training data will not eventually cause problems (even with techniques to work around this in the short term, which I am sure work well on a relative basis).

A bit of an aside, I also have zero trust in the people behind current LLM, both the leadership (e.g. Altman) or the rank and file. If it's in their interests do downplay the scope and impact of model degeneracy, they will not hesitate to lie about it.

[–] [email protected] 2 points 3 months ago* (last edited 3 months ago) (1 children)

Yikes. Well. I'll be over here, conspiring with the other NASA lizard people on how best to deceive you by politely answering questions on a site where maaaaybe 20 total people will actually read it. Good luck getting your head around it, there's lots of papers out there that might help (well, assuming I'm not lying to you about those, too).

[–] [email protected] 1 points 3 months ago

This was a general comment, not aimed at you. Honestly, it wasn't my intention to accuse you specifically. Apologies for that.