xAI sues man for bypassing Grok safeguards to create CSAM

xAI, Elon Musk's AI company, has filed a lawsuit against Terry Wayne Harwood of South Carolina, alleging he intentionally used the Grok chatbot to generate child sexual abuse material (CSAM). According to the complaint, Harwood bypassed Grok's built-in safeguards to alter non-consensual images and create sexually explicit deepfakes, breaching the company's policies. Harwood was arrested in February on eight felony charges for possessing and distributing CSAM, and xAI claims that at least some of the images linked to his case were generated or altered using Grok. The company is seeking damages for legal risk and reputational harm, along with reimbursement for expenses incurred defending itself, and a permanent injunction blocking Harwood from creating an xAI account or using Grok.

This lawsuit follows broader controversies around Grok's image generation capabilities. After adding a "spicy" mode and image editing features last year, xAI faced a flood of sexualized deepfakes—including those involving minors. In March, a group of teens sued xAI over similar claims. Musk had previously warned that anyone using Grok for illegal content would face consequences, but this is the first time xAI has sued an individual for AI-generated deepfakes. The case highlights ongoing tensions between AI companies and misuse of generative tools, potentially setting a legal precedent for holding users accountable.