Skip to content
Submit incident
AII-1002-45647
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

False Legal Citations in South African Case Mavundla v. MEC Generated by AI Tool

A South African court found that legal representatives in Mavundla v. MEC had submitted multiple fabricated case citations that did not exist in any legal database, apparently generated by an AI tool and used without verification. The court confirmed that neither good intentions nor apologies excuse this fundamental breach of professional duty, and ordered mandatory referral to the Legal Practice Council.

20 September 2024 Β· MEC: Department of Co-Operative Government and Traditional Affairs KwaZulu-Natal Β· Reliability and hallucination
20 September 2024
AII-1002-456472 sources ↓
Quick facts
Category
Reliability and hallucination
Country
South Africa
Source
cliffedekkerhofmeyr.com
Date
20 September 2024
Drafted by
Raidu Incident Detection

What happened

In Mavundla v MEC: Department of Co-Operative Government and Traditional Affairs KwaZulu-Natal, legal representatives filed a supplementary notice of appeal containing several false case citations that did not exist in any recognised legal database.

Upon examination, the Pietermaritzburg High Court found that many of the cited cases were fabricated. The court conducted an independent search using ChatGPT to verify one citation and found the AI incorrectly confirmed the case's existence, demonstrating the unreliability of such tools for legal research.

Reported impact

The false citations appeared to have been generated by an AI tool, likely used by the legal team without proper verification. The court found that the legal team had relied on AI-generated material without checking its accuracy.

Index analysis

This judgment is described as a warning to legal professionals about the uncritical use of AI tools in legal research and drafting. The case demonstrates that AI tools can 'hallucinate'β€”producing case law, statutes or arguments that are entirely fictional.

Governance controls

South African courts have delivered an unequivocal warning to legal professionals that presenting AI-generated fictitious citations will result in mandatory referral to the Legal Practice Council, regardless of good intentions, genuine apologies, or mitigating circumstances.

The judgment reminds legal practitioners of their ethical obligations to the court and their clients, and the need to apply sound professional judgment when performing their duties. Legal professionals are advised to always verify AI-generated legal research before using it in court or administrative processes.

Classification

Category
Reliability and hallucination
Country
South Africa
Harm status
Actual harm
Intent
Unintentional
Timing
Post-deployment
Harm types
Public interest
Failure modes
Hallucination, Fabricated citation, Overreliance
Consequences
Regulatory investigation
AI systems
Purported AI legal research tool, ChatGPT
Regulations
FCRA (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

cliffedekkerhofmeyr.com
False Legal Citations in South African Case Mavundla v. MEC Generated by AI Tool
michalsons.com
False Legal Citations in South African Case Mavundla v. MEC Generated by AI Tool