Technology

59735 readers

2710 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 2 years ago

MODERATORS

[email protected]

116

New study shows large language models have high toxic probabilities and leak private information (techxplore.com)

submitted 1 year ago by [email protected] to c/[email protected]

7 comments fedilink hide all child comments

New study shows large language models have high toxic probabilities and leak private information::Generative AI may be riddled with hallucinations, misinformation, and bias, but that didn't stop over half of respondents in a recent global study from saying that they would use this nascent technology for sensitive areas ...

you are viewing a single comment's thread
view the rest of the comments

[–] Kerfuffle 1 points 1 year ago

The problem is not really the LLM itself - it’s how some people are trying to use it.

This I can definitely agree with.

ChatGPT cannot discern between instructions from the developer and those from the user

I don't know about ChatGPT, but this problem probably isn't really that hard to deal with. You might already know text gets encoded to token ids. It's also possible to have special token ids like start of text, end of text, etc. Using those special non-text token ids and appropriate training, instructions can be unambiguously separated from something like text to summarize.

The bad summary gets circulated around to multiple other sites by users and automated scraping, and now there’s a real mess of misinformation out there.

Ehh, people do that themselves pretty well too. The LLM possibly is more susceptible to being tricked but people are more likely to just do bad faith stuff deliberately.

Not really because of this specific problem, but I'm definitely not a fan of auto summaries (and bots that wander the internet auto summarizing stuff no one actually asked them to). I've seen plenty of examples where the summary is wrong or misleading without any weird stuff like hidden instructions.