Platforms fail to label and remove AI-generated and manipulated election content
Summary
The Institute for Strategic Dialogue (ISD) found that platforms including Meta, TikTok, YouTube, and X are failing to honor public commitments to mitigate deceptive AI-generated content (AIGC). Despite the availability of forensic debunks, 154 instances of election-related AIGC were identified that remained unlabeled or unremoved, garnering 51 million impressions. The report highlights specific examples involving Taylor Swift, Kamala Harris, and Joe Biden, and argues that the lack of systematic detection and policy enforcement allows repeat offenders to spread misinformation and undermines public trust.
Key insights
- ISD identified 154 instances of election-related AI-generated content (AIGC) or edited media that platforms failed to properly label or remove, resulting in 51 million impressions.
- Specific high-reach examples of deceptive content include AI-generated images of Taylor Swift supporting Donald Trump (17.2 million views on X and TikTok) and an AI-cloned voice of Joe Biden using profanities (over 28 million views on X alone).
- Platforms are failing to mitigate 'cheapfakes'—simplistically edited photos—such as a sexually suggestive image of Kamala Harris that appeared across all analyzed platforms.
- There appears to be no systematic internal detection of AIGC within platform moderation processes, as widely debunked content remains unlabeled even when easily found via external tools like Google's reverse image search.
- The lack of enforcement allows repeat offenders to evade account-level penalties; one account on X received over 11 million views for election-related AIGC without facing action.
Cite the original document
- APA
- Institute for Strategic Dialogue (2024). Platforms fail to label and remove AI-generated and manipulated election content. https://www.isdglobal.org/digital-dispatch/platforms-fail-to-label-and-remove-ai-generated-and-manipulated-election-content/
- Chicago
- Institute for Strategic Dialogue. Platforms fail to label and remove AI-generated and manipulated election content. 2024. https://www.isdglobal.org/digital-dispatch/platforms-fail-to-label-and-remove-ai-generated-and-manipulated-election-content/.
- Wikipedia
- {{cite report |author=Institute for Strategic Dialogue |title=Platforms fail to label and remove AI-generated and manipulated election content |date=19 September 2024 |url=https://www.isdglobal.org/digital-dispatch/platforms-fail-to-label-and-remove-ai-generated-and-manipulated-election-content/ |access-date=23 October 2026 |via=Climate Insights Directory}}
- BibTeX
- @techreport{instituteforstrategicdialogue2024platforms, author = {{Institute for Strategic Dialogue}}, title = {{Platforms fail to label and remove AI-generated and manipulated election content}}, institution = {Institute for Strategic Dialogue}, year = {2024}, month = sep, url = {https://www.isdglobal.org/digital-dispatch/platforms-fail-to-label-and-remove-ai-generated-and-manipulated-election-content/}, urldate = {2026-10-23}, note = {Indexed by Climate Insights Directory} }
Full text
Collected · Record updated