CYBERSECURITY By Genius Marketing3 min read

A Database of Court Rulings on Fake AI Citations Just Passed 2,200. Most Involve People With No Lawyer.

A legal researcher maintains a public database of court decisions in which a judge found that generative AI had produced invented material, usually citations to cases that do not exist. As of this week it holds 2,202 decisions, 1,

A Database of Court Rulings on Fake AI Citations Just Passed 2,200. Most Involve People With No Lawyer.

A legal researcher maintains a public database of court decisions in which a judge found that generative AI had produced invented material, usually citations to cases that do not exist. As of this week it holds 2,202 decisions, 1,501 of them in the United States.

The breakdown is the part worth stopping on. The largest single group of parties involved is not attorneys. It is people representing themselves, 1,267 of them, well over half the total. The story has been told as a profession embarrassing itself. The data says it is mostly ordinary people in probate, small claims, landlord and tenant disputes and debt collection defense.

Look Behind the Curtain

The failure is specific and worth understanding, because it is not the model being stupid.

These systems produce text that fits the pattern of the request. A legal citation has a shape: a case name, a volume, a reporter abbreviation, a page, a court and a year. Asked to support a proposition, a model can generate something with that exact shape, carrying a plausible name and a plausible year, attached to a proposition it genuinely does support in spirit. Everything about it is right except that the case does not exist.

That is why the error survives a read-through. A fabricated citation does not look wrong. It looks like the thing you were hoping to find, which is precisely the condition under which people stop checking.

Two cautions about the database itself, which the site states plainly. It tracks decisions where a court made a finding, not every instance of a fake citation, so the real number is larger and unknowable. And the counts are of decisions, not of people caught, which makes the popular framing of "2,202 lawyers" wrong twice over.

There is a companion finding from a different line of research that explains the self-represented share. A randomized study this spring had participants solve problems with an assistant and then without it. The group that had asked the assistant for direct answers performed worse afterwards than they had at the start. The group that asked for hints showed no such drop. Same tool, same people, different request, opposite outcome.

The Capability Multiplier

Put those two findings together and you get a usable rule: ask for the structure, never for the authority.

An assistant is genuinely strong at the parts of a legal document that defeat most people. It can explain what a summons is asking of you and by when. It can turn a dense notice into plain language. It can build a timeline, organize exhibits, draft the factual narrative of what happened in order, and produce a letter that is calm and unemotional instead of furious, which is the register that works in writing.

What it must not supply is the law. Every case name, statute section and rule number has to come from a source you opened yourself, and in most of the country that means a free one. Court self-help centers publish fill-in forms for exactly the disputes above. Many public libraries hold legal databases. Court clerks cannot give legal advice but will tell you which form and which deadline.

The verification step is mechanical and takes a minute. For every citation in anything you are about to file, search the case name and confirm it exists, that it says what it was offered as saying, and that it is from a court that binds yours. Any one of the three failing kills it.

Do that and you have most of the benefit with none of the exposure. The sanctions in that database are real, the dismissals are real, and the judge reads the filing either way.

The Sovereign Action

Use it on the paperwork. Open the law yourself.

  • Never file a citation you have not personally confirmed exists, says what you claim, and comes from a court that applies to your case.
  • Ask for hints and explanations rather than finished answers. The measured difference in retention between those two requests is large.
  • Use the assistant for timelines, document organization, plain-language summaries and tone. That is where it earns its place.
  • Start at the court's self-help center and the free forms before anything else. They are written for your jurisdiction, which a chatbot is not.
  • For anything with real money or your home at stake, get a consultation, even a short paid one. An assistant is preparation, not representation.