Lawyer Fined $5,000 After ChatGPT Invented Fake Witnesses in Court

The New Mexico Supreme Court fined lawyer Stephen Aarons $5,000 and held him in contempt after he submitted an appeal in a murder case that was written with ChatGPT. The problem? The AI invented entire people. The brief quoted witnesses who don't exist and police testimony that was never given. It even got basic facts wrong, like the shooter's clothing and appearance. A judge was stunned, asking him in open court, "Counsel, do you watch the news?"

This is called an "AI hallucination" — when a chatbot confidently makes things up. ChatGPT doesn't look up facts like a search engine. It predicts likely-sounding words, which means it can produce fake names, fake quotes, and fake court cases that read as completely real. Aarons told the court he thought the tool would give him a "bulletproof summary." He never checked.

He's far from alone. Courts across the country are seeing a wave of AI-fabricated citations. Last year, a judge blasted two law firms for filing a brief full of false legal references. Lawyers for MyPillow's Mike Lindell were also fined for AI-generated misquotes. As more professionals lean on chatbots to save time, the gap between "sounds right" and "is right" keeps catching people.

The lesson isn't that AI is useless — it's that AI is a first draft, not a final answer. Whether you're writing a work email, a school paper, or a legal filing, treat every fact, name, and quote it gives you as unverified until you check it yourself. Five thousand dollars is a cheap lesson for a lawyer. For the rest of us, the cost of trusting AI blindly could be our reputation — or someone's freedom.