Lawyers Used AI to Draft a Legal Brief—and Got Everything Wrong
AI tools are popping up everywhere, including in legal work. But a recent case from California shows the risks of relying on AI without proper checks. Two law firms filed a legal brief filled with completely fabricated cases and quotes generated by AI. The result? They faced $31,000 in sanctions for submitting bogus information to the court.
Fictional Citations in a Civil Lawsuit Against State Farm
The case involved a civil lawsuit against State Farm. A plaintiff’s attorney used Google Gemini to create a rough outline of the brief. Unfortunately, the AI-generated outline included fake citations and cases. This document made its way to the law firm K&L Gates, where no one verified the citations before filing the brief.
U.S. Magistrate Judge Michael Wilner caught the errors when he tried to confirm the citations. He discovered that the cases and quotes didn’t exist at all—these were outright fabrications. The judge described the mistake as lawyering done with the expertise of an actor pretending to be a lawyer.
Judge Wilner’s Response and Sanctions
Judge Wilner issued an Order to Show Cause, and under oath, the lawyers admitted they had used both Google Gemini and Westlaw’s CoCounsel AI tools to draft the initial document. Yet, they failed to disclose this or verify the AI-generated content. The court’s message was clear: blindly trusting AI to create legal documents without thorough fact-checking is a serious professional risk.
This case highlights the dangers of relying on generative AI in legal research and drafting without human oversight. AI can produce plausible-sounding but false information, which can mislead even experienced judges and damage a lawyer’s credibility and practice.
Lessons for Legal Professionals
- Always verify every citation and quotation, especially if AI tools contributed to the document.
- Disclose the use of AI tools where appropriate to maintain transparency with the court.
- Use AI as an assistant, not a replacement, for rigorous legal research and drafting.
For legal professionals interested in learning how to integrate AI tools responsibly, there are resources that offer practical training on AI in law. These courses can help you understand how to leverage AI effectively while avoiding pitfalls like those seen in this case. Explore relevant options at Complete AI Training - Courses by Job.
AI’s role in legal work is growing, but this incident is a clear warning: human expertise and diligence remain essential. No AI tool can replace the responsibility that lawyers have to verify and stand behind the content they submit to courts.
Your membership also unlocks:
