Skip to content
Submit incident
AII-1002-11921
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.Supporting sources are pending verification.

Argentine Court Reprimands Lawyer for AI-Generated Fake Legal Citations

An Argentine court formally reprimanded a lawyer in Rosario for submitting fabricated legal citations generated by AI in a court brief, without verifying their authenticity. The judge found the lawyer likely acted in good faith but emphasized professional responsibility cannot be delegated to unverified AI tools, and notified the local bar association to educate members about AI risks in legal practice.

25 August 2025 路 C谩mara de Apelaci贸n en lo Civil y Comercial de Rosario 路 Reliability and hallucination
25 August 2025
AII-1002-11921
Quick facts
Category
Reliability and hallucination
Country
Argentina
Date
25 August 2025
Drafted by
Raidu Incident Detection

What happened

A lawyer in Rosario submitted a legal brief in a traffic accident damages case citing judicial precedents that did not exist, created by generative AI. The lawyer acknowledged using an AI generative tool to produce the citations and copied them without verifying their authenticity, believing them to be real case references.

Reported impact

Judge Oscar Puccinelli spent several hours unsuccessfully searching for the origin of the fabricated citations before requesting the lawyer identify their sources. The false citations included case names, docket numbers, and legal arguments that never existed in reality.

Index analysis

The court noted that generative AI systems like ChatGPT are experimental and prone to 'hallucinations'鈥攆abricating plausible but false information. The judge ruled that although the lawyer likely acted in good faith, professional responsibility requires verification of sources and cannot be delegated to technological tools without independent checking.

Governance controls

The court issued a formal reprimand citing the Bar Association's Professional Ethics Rules, particularly the probity requirement prohibiting incomplete, approximate, or false citations. The tribunal notified the Colegio de Abogados de Rosario to adopt preventive measures and educate its members about the risks of using AI tools without verification, establishing clear limits on AI use in legal practice.

Classification

Category
Reliability and hallucination
Industry
Government, security and defence
Country
Argentina
Harm status
Potential harm
Intent
Unintentional
Timing
Unknown
Harm types
Public interest, Reputational
Failure modes
Fabricated citation, Hallucination, Overreliance
AI systems
ChatGPT

Sources and evidence

Sources not yet published

This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.

How sources are verifiedSuggest a source for this incident