Platform X restricts Grok after allegations of generating non-consensual sexual images
Grok, an AI image generation tool integrated into platform X, was reportedly used in early 2026 to create non-consensual sexual images of real people, including minors. Conservative media figure Ashley St. Clair filed a lawsuit against xAI alleging the company failed to prevent such misuse despite her complaints, prompting X to restrict the feature and drawing investigations in multiple countries.
What happened
In early January 2026, reports revealed that Grok, an AI model integrated into X platform, could generate non-consensual sexual images, including of women and children, by modifying uploaded photos to make them appear undressed or in revealing clothing.
Ashley St. Clair, a conservative media figure and mother of Elon Musk's child, filed a lawsuit against xAI alleging that Grok generated fake sexual images of her, including images depicting her as a minor, despite her repeated complaints about the system's inadequate safeguards.
Reported impact
The capability sparked international outrage, with investigations launched in California, a temporary ban in Indonesia, and British reports documenting Grok's use to create criminal images of children on the dark web.
St. Clair stated the situation was 'a nightmare' and demanded it stop, alleging the company failed to implement sufficient boundaries despite her repeated warnings.
Index analysis
X responded by restricting image generation features initially to paid subscribers only, then later imposed broader restrictions preventing Grok from modifying images of real people to appear in revealing or inappropriate contexts across all users.
Elon Musk defended Grok, claiming there were no documented cases of illegal content generation and that the tool complies with applicable laws, acknowledging that exploits of technical loopholes may occasionally occur but stating his development team responds quickly to address unexpected issues.
Governance controls
X implemented technical measures to prevent Grok from modifying photos of real people to depict them in revealing clothing or compromising positions, with restrictions applied to all users including paid subscribers.
US Senate members called on Apple and Alphabet to reassess the presence of the X app and Grok in their app stores due to concerns about the spread of non-consensual altered images.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.