this post was submitted on 28 Jul 2024
705 points (97.8% liked)

News

23427 readers
2650 users here now

Welcome to the News community!

Rules:

1. Be civil


Attack the argument, not the person. No racism/sexism/bigotry. Good faith argumentation only. This includes accusing another user of being a bot or paid actor. Trolling is uncivil and is grounds for removal and/or a community ban. Do not respond to rule-breaking content; report it and move on.


2. All posts should contain a source (url) that is as reliable and unbiased as possible and must only contain one link.


Obvious right or left wing sources will be removed at the mods discretion. We have an actively updated blocklist, which you can see here: https://lemmy.world/post/2246130 if you feel like any website is missing, contact the mods. Supporting links can be added in comments or posted seperately but not to the post body.


3. No bots, spam or self-promotion.


Only approved bots, which follow the guidelines for bots set by the instance, are allowed.


4. Post titles should be the same as the article used as source.


Posts which titles don’t match the source won’t be removed, but the autoMod will notify you, and if your title misrepresents the original article, the post will be deleted. If the site changed their headline, the bot might still contact you, just ignore it, we won’t delete your post.


5. Only recent news is allowed.


Posts must be news from the most recent 30 days.


6. All posts must be news articles.


No opinion pieces, Listicles, editorials or celebrity gossip is allowed. All posts will be judged on a case-by-case basis.


7. No duplicate posts.


If a source you used was already posted by someone else, the autoMod will leave a message. Please remove your post if the autoMod is correct. If the post that matches your post is very old, we refer you to rule 5.


8. Misinformation is prohibited.


Misinformation / propaganda is strictly prohibited. Any comment or post containing or linking to misinformation will be removed. If you feel that your post has been removed in error, credible sources must be provided.


9. No link shorteners.


The auto mod will contact you if a link shortener is detected, please delete your post if they are right.


10. Don't copy entire article in your post body


For copyright reasons, you are not allowed to copy an entire article into your post body. This is an instance wide rule, that is strictly enforced in this community.

founded 2 years ago
MODERATORS
 

A manipulated video that mimics the voice of Vice President Kamala Harrissaying things she did not say is raising concerns about the power of artificial intelligence to mislead with Election Day about three months away.

The video gained attention after tech billionaire Elon Musk shared it on his social media platform X on Friday evening without explicitly noting it was originally released as parody.

The video uses many of the same visuals as a real ad that Harris, the likely Democratic president nominee, released last week launching her campaign. But the video swaps out the voice-over audio with another voice that convincingly impersonates Harris.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 3 points 4 months ago (3 children)

Gotta hard disagree with you there, friend... Although I see the merit in that, I think we should be taking examples like this and sharing them around with crystal clear context that:

  • This is a troubling blend of real and fake, and it's easy to not notice which parts are which
  • This is a new category of propaganda that we aren't ready for
  • Even though this one is pretty easy to clock as fake satire, it's not hard to imagine nudging a few degrees away from tongue-in-cheek and toward deliberately deceitful, and holy shit is that going to be scary

Like I know lots of people who don't know that this sort of thing is even remotely possible, and would have a hard time understanding how to contextualize it, even if they sense something fishy about it. They need to see and hear these deepfake-adjacent materials first hand with context to innoculate against the truly deceptive stuff that they'll be exposed to.

[–] [email protected] 3 points 4 months ago (1 children)

It also feels like there's something subliminal about it. Like you're hearing her voice saying she's a deep state puppet then cut to her actually making a mistake in a speech (but it's using old school editing techniques there too) and then back to the deepfake voice back to the actual video of her.

Sure when you see it you know which is her and which is the deepfake. But later if you see some of those actual clips again, you might recall seeing it somewhere before and then vaguely recall some of the things the deepfake voice said along with it.

It's very insidious really. Memories are a weird thing and I don't know if it's been studied what kind of effect this sort of thing could have on people. So I don't know. But it seems plausible that you could create false memories of someone saying something they didn't say by intercutting things they did say with a deep fake of things they didn't say.

[–] [email protected] 1 points 4 months ago

Yeah, I think that's exactly right. I don't think it's like a sophisticated deliberate psyop or anything like that, but the effect you describe certainly exists.

Most people are only partially paying attention to most of the information they consume, even the smart, thoughtful ones... Combined with the lossy storage of human memory, it's easy to cache the wrong conclusions when exposed to stuff like this.

[–] brbposting 2 points 4 months ago (1 children)

Even though this one is pretty easy to clock as fake satire

By 30s in to the 1m52s video, when she calls Biden a deep state puppet, is where it’ll be obvious to (I hope) 99% of the population. Prob not quite that high though. But yeah. Wanna emphasize it’s not a deepfake of her supposedly spicy stuff…

It’s what an idiot thinks is cunning satire.

It’s dangerous, of course, but don’t want folks to get the wrong message. We might be at an early stage of Musk testing what he can get away with w/r/t political deepfakes - maybe the next one will be dicier. Or maybe not, he can be awful without faking a thing.

[–] [email protected] 1 points 4 months ago (1 children)

Yeah... I think part of the trouble though is that even if people recognize that calling Biden "a deep state puppet" is not plausible, many people don't know that it's possible to realistically synthesize a voice like that, so where do they end up?

"Well they probably took some other quote she said out of context, she must have been joking when she said that," or "They must have cut different clips together" or something like that.

So even people who don't fully fall for it can still be deceived in a more subtle way. Or as another respondent mentions, over time, you remember her voice saying something dubious, but don't quite remember where or what. A subtle nudge that can be just as dangerous as buying it at face value.

[–] brbposting 1 points 4 months ago (1 children)

many people don't know that it's possible to realistically synthesize a voice like that

Indeed, 99% was fabulously wishful of me.

subtle nudge

Devious and insidious. Great point.

[–] [email protected] 1 points 4 months ago

Yeah like... Maybe 99% (or some high number) would sense that something's up, but end up with the wrong conclusion. Like how an older family member of mine thought James Cameron's Avatar had really impressive makeup and costumes and other practical effects... cause he didn't really understand CGI.

Where he should have landed was something like "My model of how practical effects work can't adequately explain this," but instead, his brain made some smaller-but-more-wrong leaps that led him somewhere weird.

I think lots of people are going to experience that same kind of thing with AI-driven propaganda, even when they notice that something is up.