tech
‘They feel true’: political deepfakes are growing in influence
AI images of people – such as women in military contexts – are making money and serving as propaganda, researchers say
TL;DR
- Online content creators are fabricating people and using them in military contexts for profit and propaganda.
- AI-generated avatars, like Jessica Foster, have gained large followings and generated revenue through platforms like OnlyFans.
- The amount of political deepfakes has increased dramatically due to improvements in generative AI technology.
- Fake avatars can be used for political purposes, such as influencing public opinion during elections or conflicts.
- Political deepfakes can be persuasive even if viewers know they are not real, as they reinforce existing beliefs.
- Researchers are concerned about the potential for 'AI swarms' to infiltrate communities and fabricate consensus.
- Efforts like the Coalition for Content Provenance and Authenticity are developing standards for content origin and edits.
- Tech companies are inconsistently labeling AI-generated content, with significant gaps in implementation.
- Immediate action is needed to address the challenge of discerning real from synthetic content.