Judge Learns Lawyers on Both Sides of Case Used AI, Cancels Trial, Kicks Everyone Off the Case#AI #law
Judge Learns Lawyers on Both Sides of Case Used AI, Cancels Trial, Kicks Everyone Off the Case
The lawyers on both sides of a federal court case in Mississippi were caught using artificial intelligence, a situation where, effectively, generative AI tools were used to argue against each other. The judge wrote in a blistering sanctions order, that the lawyers wasted the court’s time, and that “in an era of rampant unverified AI usage within the legal field, this case presents a prime example of the risk associated with serving as a rubber-stamp.”“This case presents the Court with an unusual scenario—attorneys for both litigants engaged in similar sanctionable conduct,” Sharion Aycock, senior United States District Judge for the Northern District of Mississippi wrote in a sanctions order. “This court is yet again ‘burdened with addressing AI hallucinations court filings.’”
The case in question involved a contractual dispute between lawyer Tom Withers and the city of Aberdeen, Mississippi, over apparently unpaid legal fees (Withers was not representing himself and was not sanctioned by the court). The case was first noticed by Rob Freund, a lawyer who frequently posts about cases involving AI hallucinations. Freund called it a “comedy of AI errors,” and suggested “there were two clients who basically were paying for ChatGPT (or whatever LLM) to argue against itself.”
404 Media has repeatedly covered the phenomenon of lawyers using AI to prepare their filings, and the specifics in this court case follow a similar pattern to what we’ve seen before: Lawyers for both sides cited nonexistent, hallucinated cases while making their arguments. The difference is that every lawyer involved in the case is implicated, leading Aycock to pause the proceedings, cancel the trial, and disqualify all four lawyers involved. Two of the lawyers were barred from appearing before the court for two years; all lawyers received a fine of between $1,000 and $3,500, depending on Aycock’s assessment of their culpability for not verifying the outputs of the AI they used.
Judges around the country have been increasingly frustrated with lawyers who use AI; last week, we wrote about a judge who ripped into various lawyers for citing hallucinated cases in New York.
All four lawyers involved either admitted to directly using AI or admitted to rubber stamping legal briefs that had been prepared with AI without reviewing them. Aycock wrote that at a hearing in January, “each of the attorneys expressed embarrassment and apologized to the court.” One of the lawyers said they used an AI tool to do legal research; another, Kathleen Wilson, admitted to using an AI tool called First Drafts to write the entire briefing. The two other attorneys said they did not review the briefs in question and submitted them to the court.
Notably, Aycock said that Wilson had since been caught continuing to use AI after the court had detected she was using it. “Wilson explained that she was shocked when the Court issued the show cause order pointing out the hallucinated cases appearing in her filing. In essence, Wilson took the position that she was unaware that AI could produce hallucinated cases and explained that she did not even know what a hallucinated case was,” Aycock said. “The Court finds that explanation to be insufficient and incredulous.”
“The Court is compelled to note that it has serious concerns that Wilson has continued this practice of AI misuse in other cases after she was put on notice of her violations in this case,” she added, noting that other judges in other cases had found hallucinated cases in Wilson’s filings as recently as April, four months after she was initially asked to explain her AI use in this case. “Her continued AI misuse demonstrates an extreme dereliction of professional responsibility on her part. Though this Court cannot consider subsequent conduct that did not occur before it in determination of the appropriate sanction(s) in this case, it finds that at minimum Wilson’s apologies to this Court on January 20, 2026 were not sincere.”
Another lawyer, Kathryn Williams, admitted to using an AI tool that she did not name to do research. Notably, that tool was described as being built for “in-house legal research,” and that the tool in question is not supposed to hallucinate cases.
“Williams explained that the software was built to produce results from jurisdictions in which her law firm typically practiced, which did not include Mississippi,” Aycock wrote. “She explained that this case is the only Mississippi case she has ever been involved in, yet she resorted to using the software apparently knowing that it was not designed to encompass Mississippi law.”
Lawyer Caught Using AI While Explaining to Court Why He Used AI
The attorney not only submitted AI-generated fake citations in a brief for his clients, but also included “multiple new AI-hallucinated citations and quotations” in the process of opposing a motion for sanctions.Samantha Cole (404 Media)