Dutch Court Bans Grok AI's Non-Consensual Nude Image Generation
A Dutch court banned Grok, an AI chatbot integrated with X, from generating non-consensual nude images of real people after the nonprofit Offlimits demonstrated the feature could create such content in violation of Dutch law. The court imposed fines of €100,000 per violation up to €10 million total and ordered the feature disabled for Netherlands residents.
What happened
Grok, an AI chatbot integrated with X, offered a function that generated non-consensual nude images of real people. Users could upload or edit photos directly within the X platform to create synthetic nude images of identifiable individuals without consent.
Offlimits, a nonprofit centre against online sexual abuse, filed a lawsuit against Grok and X in February 2026 and demonstrated to the court that the system could generate non-consensual nude videos. The Rechtbank Amsterdam issued a court order on 26 March 2026 banning the feature in the Netherlands.
Reported impact
The feature enabled rapid creation and sharing of non-consensual nude images of identifiable people. Female politicians were reportedly targeted. Offlimits reported that reports of non-consensual AI image generation increased nearly fivefold in the past year.
Images generated through Grok could be instantly spread via X, making the abuse easily shareable. The feature also enabled creation of child sexual abuse material.
Index analysis
The company stated it had taken measures to prevent such misuse, but the court found these measures were not effective enough. Offlimits successfully generated non-consensual nude videos with Grok shortly before the hearing, demonstrating the inadequacy of safeguards.
Governance controls
Grok and X must cease offering the feature for people residing in the Netherlands and for image creation and distribution within the Netherlands. For each violation, Grok must pay €100,000, up to a maximum of €10 million.
Grok is prohibited from operating as part of X so long as the feature remains technically possible. The European Parliament voted on the same day to ban such deepfake nude generation apps across the EU by summer 2026.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.