Skip to content
Submit incident
AII-1002-60571
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.

Apple Intelligence AI generates false news alerts

Apple Intelligence generated false news alerts to iPhone users in late 2024, fabricating details about public figures and creating notifications falsely attributed to reputable news organizations like the BBC. Apple acknowledged the errors and announced a software update to better label AI-generated content in notifications.

December 2024 · Apple · Reliability and hallucination
December 2024
AII-1002-605714 sources ↓
Quick facts
Category
Reliability and hallucination
Country
United States
Source
SAPO Tek
Date
December 2024
Drafted by
Raidu Incident Detection

What happened

Apple Intelligence, launched in the United States in late 2024, generated false news alerts summarizing articles from news outlets including the BBC. The AI-generated notifications contained fabricated information, including false claims that Luigi Mangione had committed suicide and that tennis player Rafael Nadal had come out as homosexual.

Reported impact

The BBC stated: 'It is essential for our audience to be able to trust each piece of information or article published in our name,' noting the errors as 'problematic.' iPhone users received false information attributed to news organizations they trusted.

Index analysis

Apple Intelligence was designed not to create highlights for notifications on sensitive topics, according to statements from the company's vice president for software engineering. The system nonetheless generated false alerts summarizing news articles.

Governance controls

Apple announced it would release a software update within weeks to clearly label when notification summaries were generated by AI. The company stated: 'A software update in the coming weeks will better clarify when text presented is a summary provided by Apple Intelligence' and encouraged users to report unexpected notification summaries.

Classification

Category
Reliability and hallucination
Industry
Media, social platforms and marketing
Country
United States
Harm status
Actual harm
Intent
Unintentional
Timing
Post-deployment
Harm types
Reputational, Public interest
Harmed
General public, Business
Failure modes
Hallucination, Fabricated citation, Agent misaction
AI systems
Apple Intelligence

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

SAPO Tek
Apple vai passar a informar sempre que notificações tenham conteúdo criado por IA - SAPO Tek
7 January 2025
SIC Notícias
"Rafael Nadal é gay": aplicação da Apple quer resumir notícias mas acaba por... inventar informação
8 January 2025
Publico
Ferramenta de Inteligência Artificial da Apple inventa informação nas notificações de notícias
8 January 2025
Notícias ao Minuto
Apple diz que vai corrigir erro de IA responsável por notícias falsas
9 January 2025