Skip to content
Submit incident
AII-1002-59711
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.Supporting sources are pending verification.

Fable App Removes AI-Generated Summaries Over Offensive Content

Fable's AI-generated annual reading summaries produced offensive comments about users' reading choices based on race, gender, sexuality and disability. The company removed all AI-powered summary features and announced new safeguards after the summaries drew complaints from users including Tiana Trammell and other community members.

29 December 2024 Β· Fable Β· Discrimination and fairness
29 December 2024
AII-1002-59711
Quick facts
Organization
Fable (subject)
Category
Discrimination and fairness
Country
United States
Date
29 December 2024
Drafted by
Raidu Incident Detection

What happened

Fable's AI-generated annual reading summaries produced offensive content targeting users based on race, gender, sexuality and disability. User Tiana Trammell received a summary suggesting she, a Black reader, 'don't forget to surface for the occasional white author.' Other users received summaries mocking disability narratives as earning 'an eye-roll from a sloth' and disparaging one reader's diverse reading selections with 'making me wonder if you're ever in the mood for a straight, cis white man's perspective.'

Fable's head of product Chris Gallello said the company had implemented safeguards including offensive language filters, but these 'failed this time around.' The company said it 'underestimated how much work needs to be done' to make AI models operate responsibly.

Reported impact

Users described being shocked and hurt by the summaries. Tiana Trammell said she initially thought 'this cannot be what I am seeing.' Writer Danny B. Groves noted the comment about his diverse reading felt disorienting, as it resembled years when he could not find books representing him as a Black, gay man.

Index analysis

The AI system generated content that stereotyped and disparaged readers based on protected characteristics. The summaries appeared designed to be playful but instead reinforced offensive assumptions about reading choices tied to race, gender, sexuality and disability.

Governance controls

Fable announced it would remove all AI-generated features including summaries and year-end reading wraps. Changes included disclosures that summaries were AI-generated, opt-out capability, and a thumbs-down button to alert the company to problems.

Classification

Organization
Fable (subject)
Category
Discrimination and fairness
Industry
Consumer services
Country
United States
Harm status
Actual harm
Intent
Unintentional
Timing
Post-deployment
Harm types
Psychological, Reputational
Harmed
Consumers
Failure modes
Biased model, Content moderation failure
Consequences
Content removal
AI systems
Fable AI Reader Summaries

Sources and evidence

Sources not yet published

This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.

How sources are verifiedSuggest a source for this incident