Fake AI Content About the Iran War Is All Over X
Elon Musk's Grok chatbot misidentifies videos and shares AI-generated images, worsening X's disinformation crisis.
Since the onset of the Iran-Israel conflict, the social media platform X has been inundated with AI-generated disinformation, and its own AI tool, Grok, is exacerbating the problem. When disinformation expert Tal Hagin asked Grok to verify a video about Iranian missiles, the chatbot failed, misidentifying the location and date. It then attempted to substantiate its incorrect claim by sharing an AI-generated image, which Hagin labeled 'AI slop.' This incident highlights a platform increasingly unhinged from reality, where paid 'blue check' accounts and Iranian officials are using accessible AI tools to spread sophisticated fake content, from videos of a high-rise on fire to images of captured Delta Force members, garnering millions of views.
The proliferation is not limited to conflict imagery; AI is also being used to push antisemitic narratives, with pro-regime networks sharing fabricated content. In response to the flood of fakes, X announced it would temporarily demonetize accounts posting unlabeled AI-generated conflict videos, though its enforcement remains unclear. Experts warn that the ease of creating convincing AI 'slop' without consequences is pushing society toward a post-fact world, emphasizing the urgent need for regulations against AI abuse to prevent further harm and maintain a baseline of shared reality.
- X's Grok AI chatbot failed a basic fact-check, misidentifying a video and sharing an AI-generated image as 'proof'.
- AI-generated fake videos and images, like one of a US B-2 bomber being shot down, have been viewed over 5 million times on the platform.
- X's new policy demonetizes accounts for unlabeled AI conflict videos, but experts say a lack of regulation is pushing us toward a 'post-fact' world.
Why It Matters
The failure of AI tools on major platforms to curb disinformation erodes trust and accelerates the spread of dangerous, conflict-fueling propaganda.