Court Orders X to Remove AI-Generated Deepfake of Gretchen and Identify Creator
A Brazilian court ordered X to remove and keep offline a deepfake video of singer Gretchen created with AI, and to disclose the IP address of the user who posted it. The video falsely depicted Gretchen promoting a show at a fictional venue with sexual activities, referencing a 2010 campaign she conducted.
What happened
A deepfake video using AI was created to depict singer Gretchen promoting a show at a fictional venue called 'Cabaré da Cinderela' with sexual activities, referencing a 2010 campaign she conducted for the Prefeitura of Itamaracá, Pernambuco.
The video circulated on X in 2024. Gretchen's legal team filed suit in April 2025. Judge Camila Rodrigues Borges de Azevedo of the 19ª Vara Cível issued a decision on June 3, 2025, ordering X to remove and keep the content offline and to provide the IP address of the user who posted it.
Reported impact
The deepfake used Gretchen's image and voice to create false statements, potentially damaging her reputation and subjecting her to non-consensual sexual depiction.
Index analysis
During the process, X cited article 19 of the Marco Civil da Internet, which shields platforms from liability for third-party content unless they fail to comply with a judicial order to remove it. The court's decision did not punish X under article 19 because the platform complied with the removal order.
Governance controls
The court ordered X to maintain the content offline and disclose the IP address to enable identification of the creator. X retained the right to appeal the decision.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.