BecomeMe

832 readers

1 users here now

Social Experiment. Become Me. What I see, you see.

founded 2 years ago

MODERATORS

Renneder

PoisonGPT: How we hid a lobotomized LLM on Hugging Face to spread fake news (blog.mithrilsecurity.io)

submitted 2 years ago by Renneder to c/becomeme

5 comments fedilink hide all child comments

Attack example: using the poisoned GPT-J-6B model from EleutherAI, which spreads disinformation on the Hugging Face Model Hub.
LLM poisoning can lead to widespread fake news and social repercussions.
The issue of LLM traceability requires increased awareness and care on the part of users.
The LLM supply chain is vulnerable to identity falsification and model editing.
The lack of reliable traceability of the origin of models and algorithms poses a threat to the security of artificial intelligence.
Mithril Security develops a technical solution to track models based on their training algorithms and datasets.

all 6 comments

sorted by: hot top controversial new old

[–] Zeppo 7 points 2 years ago

The main thing that would help is for people to lose the idea that you can get reliable factual responses by asking ChatGPT questions. Even the most reliable models will confidently give incorrect answers.

[–] paulcdb 3 points 2 years ago (1 children)

Sadly the internet has been ruined to the point its now just 99% opinions!

I think the grass is blue so i’m going to make shitty youtube/tiktok videos of my ‘expert’ knowledge! Even worse are the idiots who vote the videos and comment how grateful they are… although who knows if thats people or bots anymore! 🤦‍♂️

I really want a internet that requires a ton of skills to access and isn’t a shithole of money grabbing idiots trying to game everything and shoving 3 million ads per second at you! 😞

[–] MomoTimeToDie 1 points 2 years ago

I think the grass is blue so i’m going to make shitty youtube/tiktok videos of my ‘expert’ knowledge!

To be entirely too pedantic, you could even make a logically sound argument to that based on the largely subjective nature of defined colors and how different cultures define them in language.

[–] MomoTimeToDie 3 points 2 years ago

Breaking news: people can lie on the internet