Platforms fail to label and remove AI-generated and manipulated election content

Report an error

Summary

AI-generated

This summary is written by a language model reading the source document. It is not the publisher's words and is not a substitute for the original.

Learn more about AI enrichment

The Institute for Strategic Dialogue (ISD) found that platforms including Meta, TikTok, YouTube, and X are failing to honor public commitments to mitigate deceptive AI-generated content (AIGC). Despite the availability of forensic debunks, 154 instances of election-related AIGC were identified that remained unlabeled or unremoved, garnering 51 million impressions. The report highlights specific examples involving Taylor Swift, Kamala Harris, and Joe Biden, and argues that the lack of systematic detection and policy enforcement allows repeat offenders to spread misinformation and undermines public trust.

Key insights

AI-generated

These insights are written by a language model reading the source document. They are not the publisher's words and are not a substitute for the original.

Learn more about AI enrichment
  • ISD identified 154 instances of election-related AI-generated content (AIGC) or edited media that platforms failed to properly label or remove, resulting in 51 million impressions.
  • Specific high-reach examples of deceptive content include AI-generated images of Taylor Swift supporting Donald Trump (17.2 million views on X and TikTok) and an AI-cloned voice of Joe Biden using profanities (over 28 million views on X alone).
  • Platforms are failing to mitigate 'cheapfakes'—simplistically edited photos—such as a sexually suggestive image of Kamala Harris that appeared across all analyzed platforms.
  • There appears to be no systematic internal detection of AIGC within platform moderation processes, as widely debunked content remains unlabeled even when easily found via external tools like Google's reverse image search.
  • The lack of enforcement allows repeat offenders to evade account-level penalties; one account on X received over 11 million views for election-related AIGC without facing action.

Cite the original document

APA
Institute for Strategic Dialogue (2024). Platforms fail to label and remove AI-generated and manipulated election content. https://www.isdglobal.org/digital-dispatch/platforms-fail-to-label-and-remove-ai-generated-and-manipulated-election-content/
Chicago
Institute for Strategic Dialogue. Platforms fail to label and remove AI-generated and manipulated election content. 2024. https://www.isdglobal.org/digital-dispatch/platforms-fail-to-label-and-remove-ai-generated-and-manipulated-election-content/.
Wikipedia
{{cite report |author=Institute for Strategic Dialogue |title=Platforms fail to label and remove AI-generated and manipulated election content |date=19 September 2024 |url=https://www.isdglobal.org/digital-dispatch/platforms-fail-to-label-and-remove-ai-generated-and-manipulated-election-content/ |access-date=23 October 2026 |via=Climate Insights Directory}}
BibTeX
@techreport{instituteforstrategicdialogue2024platforms, author = {{Institute for Strategic Dialogue}}, title = {{Platforms fail to label and remove AI-generated and manipulated election content}}, institution = {Institute for Strategic Dialogue}, year = {2024}, month = sep, url = {https://www.isdglobal.org/digital-dispatch/platforms-fail-to-label-and-remove-ai-generated-and-manipulated-election-content/}, urldate = {2026-10-23}, note = {Indexed by Climate Insights Directory} }

Full text

Collected · Record updated