Skip to content
Submit incident
AII-1001-13281
AllegedThe record is a lawsuit, complaint or accusation that has not been decided.

Dutch Organizations Sue X Over AI Chatbot Grok's Generation of Illegal Nude Images

Dutch organizations Offlimits and Fonds Slachtofferhulp have filed a lawsuit against X and its AI chatbot Grok, which reportedly can generate non-consensual sexual imagery of real people including minors. The case is heard in March 2026, with organizations seeking to restrict Grok's functionality and imposing a daily fine of €100,000 if X and Elon Musk's companies do not comply.

26 February 2026 Β· X Β· Harmful and abusive content
26 February 2026
AII-1001-132812 sources ↓
Quick facts
Category
Harmful and abusive content
Country
Netherlands
Source
NRC
Date
26 February 2026
Drafted by
Raidu Incident Detection

What happened

Offlimits and Fonds Slachtofferhulp filed a lawsuit against X and Grok on 26 February 2026, seeking to restrict the AI chatbot's ability to generate non-consensual sexual imagery. The organizations filed for a preliminary injunction with a penalty of €100,000 per day if X does not comply.

According to the Center for Countering Digital Hate, Grok generated approximately three million sexualized AI images in an eleven-day period in January, including 23,000 images of minors. Offlimits reported that 300 people came to the organization in 2025 with complaints of being extorted using sexualized AI images, and the organization classified 2,200 AI-generated images as child abuse material.

Reported impact

Offlimits director Robbert Hoving stated that the psychological consequences of online sexual abuse are equivalent to offline sexual violence, with victims experiencing significant mental health impacts. Hoving described the situation as 'an accident in slow motion' and noted that Dutch victims have been harmed by images created with Grok.

The lawsuit cites X's status as a 'very large online platform' under the European Digital Services Act, which carries additional responsibility to prevent illegal material and protect minors. Hoving warned that the ease of use of these tools enables large-scale creation and distribution of illegal material.

Index analysis

Grok is integrated into X, which has over 125 million daily users according to TechCrunch. The chatbot can generate non-consensual sexual imagery from a single photograph within seconds, and images can then be spread across X and other social media platforms.

Grok remains more permissive than competing models like ChatGPT and Claude even after X modified its algorithms in mid-January following criticism from owner Elon Musk. The AI chatbot is easily manipulated to generate such content.

Governance controls

X modified Grok's algorithms in mid-January following public criticism, but according to the organizations, the changes remain insufficient. Under the European Digital Services Act, X as a 'very large online platform' has a responsibility to prevent the spread of illegal material and actively protect minors' fundamental rights.

Classification

Category
Harmful and abusive content
Industry
Media, social platforms and marketing
Country
Netherlands
Harm status
Potential harm
Intent
Unknown
Timing
Unknown
Harm types
Human or fundamental rights, Psychological, Public interest
Harmed
General public, Children
Failure modes
Content moderation failure
Consequences
Litigation
AI systems
Grok
Regulations
EU AI Act (cited)

Sources and evidence

This record was researched and written by the Index, based on the following original reporting.

NRC
Offlimits en Fonds Slachtofferhulp spannen kort geding aan tegen Grok en X: 'Voorkomen dat techbro's grensoverschrijdend gedrag faciliteren'
26 February 2026
Provinciale Zeeuwse Courant
Nederlandse instanties zijn Elon Musk spuugzat en spannen kort geding aan: 'Dit is een ongeluk in slow motion'
26 February 2026