Lawyers with decades of experience are being fined, reprimanded, and barred from courtrooms for submitting legal briefs containing fabricated rulings generated by artificial intelligence. The problem spans multiple jurisdictions, with recent cases in Mississippi, Israel, and Britain exposing how AI hallucinations are undercutting professional credibility and putting client outcomes at risk.
Mississippi federal judge sanctions attorneys over six fake precedents
In Withers v. City of Aberdeen, attorneys for both sides cited six entirely fabricated precedents. Federal Judge Sharion Aycock removed the lawyers from the case, imposed financial penalties, and revoked their pro hac vice status - the temporary privilege allowing out-of-state attorneys to appear before the court.
"At this point, no lawyer can credibly claim to be unaware of the risks," a University of Mississippi law professor who serves on the state's ethics committee told local media.
Israeli Supreme Court rebukes attorney: 'Betrayed the profession'
In February 2025, an attorney representing a petitioner in a Sharia divorce dispute at Israel's Supreme Court relied on an AI tool and directed the court to rulings that never existed. Supreme Court Justice Gila Canfy-Steinitz dismissed the petition and delivered a sharp rebuke in her ruling.
"A lawyer who files a pleading containing fabricated material, while relying on authorities that do not exist, betrays their duties to the litigant, to the court and to the legal profession," she wrote. The justice stressed that using AI does not absolve attorneys of professional responsibility or the duty to verify submissions. She refrained from imposing financial penalties only because it was the first case of its kind before the Supreme Court.
British legal scholars warn of 'digital fortune teller' risk
Dr. Eden Sarid and Dr. Haim Abraham told i24NEWS that AI could fundamentally alter the relationship between citizens and the law. "In administrative law, a person is entitled to receive an explanation for a decision concerning them," Sarid said. "But artificial intelligence is a tool without self-awareness. When judges rely on it blindly without understanding how it works, we retreat from the process of rationalization that has characterized law since the Enlightenment and return to relying on a kind of digital fortune teller."
Abraham recounted firing a lawyer his firm had hired after discovering she used ChatGPT to answer complex legal questions. "We asked complex questions and received a flat, hollow output from ChatGPT," he said. "After we confronted her, the firm admitted using it. It was a serious breach of privacy and professionalism, and we fired them immediately."
New York ruling: chatbot conversations are not privileged
A federal court in New York has ruled that information a criminal suspect enters into an AI chatbot carries no attorney-client privilege. The suspect consulted the Claude AI tool across 31 separate chats, entering sensitive case details including information from his attorneys. The FBI later seized printouts of the conversations.
The judge ruled that AI is not a lawyer, and no privilege exists. Entering information into a chatbot is legally comparable to discussing it with a stranger on the street. Platforms' terms of service make clear they do not provide legal advice and that conversations are not confidential and may be used to train their models. Clients who ask AI to value a lawsuit or disclose damaging facts could see those chats used against them during cross-examination.
The 'robot lawyer' that drew FTC action
Startups promising to replace legal counsel have encountered regulatory resistance. DoNotPay, which marketed itself as "the world's first robot lawyer," was fined $193,000 by the US Federal Trade Commission in 2024 over deceptive claims and substandard legal documents. Such ventures often risk crossing into the unauthorized practice of law, a criminal offense in several states including California.
Newer entrants like Cimphony AI tried selling an "autopilot for legal needs" but recently shut down after widespread criticism. Buried in its terms of service was a disclaimer: "The company is not a law firm and does not provide legal advice."
A California woman's verified approach wins an appeal
Lynn White, a 71-year-old Southern California woman, lost an eviction case and faced homelessness without money for an appeals lawyer. She turned to ChatGPT and developed a method to overcome its hallucinations: she cross-checked every ruling ChatGPT cited against the Perplexity search engine to confirm the cases actually existed. Armed with verified arguments, she won her appeal and had the judgment overturned.
"It feels like David and Goliath," White said. "Artificial intelligence is the slingshot."
For legal professionals seeking to understand how to use AI tools responsibly without risking sanctions or client harm, structured training on verification workflows and document review is available through AI for Legal resources. Paralegals and support staff who handle legal research automation can benefit from the AI for Paralegals learning path, which covers document review processes where hallucinations most frequently occur.
Why this matters for legal professionals
The cases make one principle clear: a machine cannot relieve a person of individual responsibility or the obligation to verify facts. Courts are treating AI-generated citations the same as any other submission - and judges are increasingly willing to impose financial penalties, revoke court privileges, and publicly name attorneys who file fabricated material. For practitioners, the standard is now explicit. Every ruling, precedent, and citation must be independently verified against primary sources before it reaches a judge's desk. The cost of skipping that step is a damaged reputation, a lighter wallet, and potentially a lost case.
Your membership also unlocks:
