Noesa
← The Casebook

Southern District of New York · 2023

He asked ChatGPT whether the cases were real. It said yes.

Six fabricated decisions reached a federal court — and the lawyer's attempt to verify them made him more confident, not less.

Published 15 August 2026

What happened

Roberto Mata sued Avianca over a knee injury from a metal serving cart on a flight to New York. When the airline moved to dismiss on limitation grounds, his lawyers filed a brief citing decisions that Avianca's counsel then could not find anywhere [1][2].

The brief had been researched with ChatGPT. Steven Schwartz, the attorney who wrote it, had no Westlaw or LexisNexis account; his firm used a service with limited federal coverage. He testified that he had assumed ChatGPT was "like a super search engine", and that he was "operating under the false perception that this website could not possibly be fabricating cases on its own" [1].

Six of the cited decisions did not exist. The court examined the fake "Varghese" opinion and found its legal analysis was "gibberish", that it cited other non-existent decisions, that quotation marks were left unpaired, and that it ended abruptly without a conclusion. Of Schwartz's prompts — "show me specific holdings", "show me more cases" — the court wrote simply that "the chatbot complied by making them up" [1].

Here is the part worth stopping on. Schwartz did try to verify. He asked ChatGPT directly whether the cases were real — "Is Varghese a real case" and "Are the other cases you provided fake". ChatGPT answered that Varghese "does indeed exist" and could be found on Westlaw and LexisNexis. He screenshotted that exchange and filed it as evidence of his diligence [1][2].

Peter LoDuca, the attorney of record, signed an affidavit annexing the fabricated opinions without reading them or asking a single question about them, and separately told the court he was away on vacation when he was not [1].

On 22 June 2023 Judge P. Kevin Castel sanctioned both attorneys and their firm $5,000, jointly and severally, finding subjective bad faith, and required them to write to every real judge falsely named as the author of a fabricated opinion [1][2].

Where the same tool helps

Nothing here says do not use AI for legal research; the court did not say that either. What the record shows is a tool used with no ground truth attached. The same model, pointed at a database it can actually retrieve from and made to return citations that resolve, is genuinely useful — the difference is whether the answer is anchored to something a person can open. Schwartz's firm did not have that database. The absence of Westlaw is the quiet cause of this entire case [1].

Where it burned

The failure was not that the model invented cases; that is a known property. It is that every check Schwartz ran was inside the system that was wrong. He asked the model. The model confirmed. He asked it again after the court raised doubts, and it doubled down, naming databases it had no access to. A verification loop that never leaves the model is not verification — it is the same claim, asked twice [1][2].

The tell

Asking the AI whether it is sure is not a check. A check has to touch something outside the model — a document you open, a database you search, a person who knows.

Confidence is generated the same way the answer is. A model asked "are you certain?" produces the words a certain person would use, which is why it so often escalates rather than backs down. This is the most expensive mistake in the casebook precisely because it feels like diligence: Schwartz did more work than a careless lawyer would have, and ended up with a screenshot of his own error, filed as proof.

Share this case

The image has the link printed on it, so it still leads back here.

The check is a habit, and habits are trained. What to never hand off is about the judgment that stays yours no matter what tool you use — and about what it means to sign your name to something.

Sources

Every source below was opened and read. Last verified 15 August 2026.

  1. [1] Mata v. Avianca, Inc., 678 F.Supp.3d 443 — opinion and order on sanctions (full text)U.S. District Court, S.D.N.Y. (Castel, J.), No. 22-cv-1461, 22 June 2023
  2. [2] Artificially Unintelligent: Attorneys Sanctioned for Misuse of ChatGPTSarah A. Emmerich, Proskauer Rose LLP — National Law Review, 30 June 2023