OpenAI bans ChatGPT accounts tied to Russian propaganda network
AI company disrupts influence campaign using its models to generate political content.
OpenAI has taken action against a covert influence operation originating from Russia, banning accounts that were using its AI models to generate political propaganda. The company's Threat Intelligence team identified and disrupted a network linked to Russia's persistent Doppelganger campaign, which was leveraging OpenAI's platforms, including ChatGPT, to create and translate content for social media. This marks a significant escalation in the use of generative AI for state-backed information operations, moving beyond simple text generation to potentially creating more convincing, multilingual personas and content designed to influence political discourse in regions like Ukraine, Europe, and the United States.
The operation used AI to generate comments, articles, and social media personas, posting them across platforms like Telegram and X. OpenAI stated that while the AI-generated content itself did not gain significant traction or reach, the use of its tools for this purpose violates its policies against deceptive activity. This incident underscores the dual-use nature of powerful AI models and the increasing difficulty for platforms to detect and moderate AI-generated influence campaigns at scale. It also raises critical questions about the responsibility of AI developers to implement safeguards and the need for industry-wide collaboration to address this emerging threat vector.
- OpenAI banned accounts tied to Russia's Doppelganger influence campaign for policy violations.
- The network used ChatGPT to generate and translate political comments and articles for social media.
- The action highlights the growing use of generative AI in state-backed propaganda operations.
Why It Matters
Shows how AI is weaponized for propaganda, forcing tech companies into a new arms race for content moderation.