this post was submitted on 01 Mar 2025
45 points (100.0% liked)
World News
721 readers
1062 users here now
Rules:
- Be a decent person
- No spam
- Add the byline, or write a line or two in the body about the article.
Other communities of interest:
founded 5 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
You can't... generate... abuse.
No more than you can generate murder.
The entire point of saying "child abuse images" is to distinguish evidence of rape from, just, drawings.
If you want drawings of this to also be illegal, fine, great, say that. But stop letting people use the language of actual real-world molestation of living human children, when describing some shit a guy made up alone.
How did they train the model? I'd say it's just as problematic if the generator was trained using CSAM.
Theoretically you should be able to generate it by cobbling together legal images.
But given the massive volume of scraped data, they've also ended up with actual CSAM in their training data. I recall seeing articles about them having to identify and remove it, but I'm definitely not adding that search to my history.
I find the legal aspect of it fascinating because proving the age of a computer generated boob is impossible unless you have access to the actual prompt used to create it, and that prompt specifically asks for an image of CSAM. And even then, who's to say the system didn't use create most of the image from legal training data, and just had underage facial features. It'll be interesting to see how they prosecute and defend against these charges.
"Draw me an image of a 1000 year old succubus stuck inside the body of a..."