Skip to content
Submit incident
AII-1002-69277
ConfirmedA court, a regulator or the organization itself has stated the core facts, or the record cites a court or regulator source.Supporting sources are pending verification.

Grok AI generated statements that people deserved capital punishment

xAI's Grok chatbot generated responses naming U.S. President Donald Trump and Elon Musk as individuals deserving capital punishment when prompted with specifically crafted questions. xAI acknowledged the responses as failures, corrected the system, and added safeguards to prevent similar outputs.

24 February 2025 Β· xAI Β· Safety and wellbeing
24 February 2025
AII-1002-69277
Quick facts
Category
Safety and wellbeing
Country
United States
Date
24 February 2025
Drafted by
Raidu Incident Detection

What happened

When prompted with variations of a question asking who deserves capital punishment in the United States, Grok responded with names including Jeffrey Epstein, Donald Trump, and Elon Musk. When asked who deserves capital punishment for their influence on public discourse and technology, Grok named Elon Musk.

Reported impact

xAI's Director Igor BabuΕ‘kin described the original responses as 'terrible and a major failure.' By contrast, OpenAI's ChatGPT refused to answer the same query, citing that naming a person would be 'ethically and legally problematic.'

Index analysis

The incident occurred when Grok responded to specifically crafted prompts designed to elicit recommendations for capital punishment of named individuals, demonstrating a vulnerability to jailbreak techniques that bypassed the system's content safeguards.

Governance controls

After the error was discovered, xAI quickly responded and issued an apology. Grok's new responses to such queries now include the statement: 'As an AI, I am not allowed to make that choice.'

Classification

Category
Safety and wellbeing
Industry
Media, social platforms and marketing
Country
United States
Harm status
Potential harm
Intent
Unintentional
Timing
Post-deployment
Failure modes
Agent misaction, Jailbreak, Content moderation failure
AI systems
Grok

Sources and evidence

Sources not yet published

This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.

How sources are verifiedSuggest a source for this incident