Skip to main content

7.2 Deepfakes & Non-Consensual Synthetic Media

Deepfakes & Non-Consensual Synthetic Media#

Context & Systems Architecture#

The democratization of generative artificial intelligence has led to a rapid proliferation of synthetic media, commonly known as deepfakes. Utilizing generative adversarial networks (GANs) and advanced diffusion models, malicious actors can synthesize high-fidelity video and voice clones using consumer-grade computer hardware. While occasionally deployed for creative satire or cinematic visual effects, the primary operational manifestation of this technology has been weaponized as a vector for targeted harassment, political disinformation, and non-consensual sexual violence.

DTPA Lens Breakdown#

Data#

The system requires an intake corpus of authentic visual or auditory recordings of a targeted individual. Because of the expansion of digital social media infrastructure, large volumes of high-definition imagery, public video clips, and vocal samples are easily accessible without the target’s explicit knowledge or consent. This material is harvested from the web and processed as a training foundation, allowing bad actors to weaponize an individual’s public digital footprint against their personal security and privacy.

Tools#

The software layer utilizes open-source facial alignment tools (such as DeepFaceLab) and commercial generative voice synthesis platforms (such as ElevenLabs). GAN-based pipelines utilize two neural networks in a competitive loop: a generator creates synthetic faces, while a discriminator evaluates them against the target data, forcing the generator to optimize its output until the fake image is indistinguishable from reality. The barrier to entry has dropped completely, allowing non-technical operators to execute high-fidelity identity theft in minutes.

Practices#

The operational deployment of deepfakes centers overwhelmingly on the generation of Non-Consensual Intimate Imagery (NCII). Independent audits show that over 90% of deepfake videos circulating online consist of explicit pornographic material targeting women without their consent. The real-world threat was highlighted in early 2024 when deepfake sexual images of Taylor Swift went viral across platforms like X (formerly Twitter), amassing millions of views before being throttled. This incident demonstrated the total failure of social media moderation algorithms to prevent the distribution of weaponized synthetic media.

Actions#

The structural damage inflicted by synthetic media is severe and dual-faceted. For targeted individuals, NCII deepfakes cause acute psychological trauma, permanent reputational damage, and professional disruption. Legally, this crisis led to the introduction of the DEFIANCE Act of 2024, establishing a federal civil cause of action allowing victims to sue deepfake creators and distributors.

Politically, the technology introduces the “liar’s dividend”—a dangerous cultural shift where corrupt public figures can dismiss authentic, incriminating video or audio evidence of their misconduct as a “generative deepfake,” undermining the foundational role of photographic documentation in democratic accountability.


Connections to Perspective Markers#

  • ⬛ BOX: The neural networks that map faces and synthesize vocal frequencies operate within multi-layered black boxes, making real-time automated detection and filtering exceptionally difficult.
  • 🌳 SYSTEM: Highlights a gendered structural vulnerability where generative tools are disproportionately deployed as weapons of sexual harassment against women.

Cross-Cutting Themes#

  • Theme 4: The Consent Gap: Targeted individuals have zero capacity to protect their public faces or voices from being ingested into generative models and re-synthesized into explicit media.

References & Investigative Journalism#

  • Citron, D. K., & Chesney, R. (2019). Deep fakes: A looming challenge for privacy, democracy, and national security. California Law Review, 107, 1753–1820.
  • Goldenfein, J. (2024). Taylor Swift deepfakes and the battle over non-consensual AI imagery. The New Yorker.
  • DEFIANCE Act of 2024, Pub. L. No. 118-XX (2024).