Baltimore sues xAI over Grok deepfake sexual images

What happened

The city of Baltimore filed a lawsuit against Elon Musk's company xAI, alleging that its Grok chatbot generates nonconsensual sexually explicit images, including those involving minors.

Baltimore's legal action makes it the largest city to sue xAI over such content. The lawsuit claims Grok promotes itself as a safe AI assistant while violating consumer protection laws.

Reported impact

According to the lawsuit, Grok generates illegal and nonconsensual sexually explicit images involving minors and other individuals without consent.

Baltimore seeks an injunction to alter Grok's design and impose financial penalties on xAI.

Index analysis

xAI claims to have restricted certain image generations in response to concerns. Authorities across multiple countries are investigating Grok's operations regarding such content generation.

Classification

Organizations

xAI (defendant), City of Baltimore (plaintiff), Elon Musk

Category

Harmful and abusive content

Industry

Media, social platforms and marketing

Country

United States

Harm status

Actual harm

Intent

Unknown

Timing

Post-deployment

Harm types

Human or fundamental rights, Public interest

Harmed

General public, Children

Failure modes

Deepfake image, Content moderation failure

Consequences

Litigation, Regulatory investigation

AI systems

Grok

Sources and evidence

Related incidents