AI-Generated Deepfakes of Indian Judges Highlight Regulatory Gaps
India's Chief Justice of India reported that morphed photos of judges created using generative AI have circulated, demonstrating misuse of AI tools. The Supreme Court is reportedly considering frameworks to regulate generative AI in the judiciary and protect against such misuse.
What happened
The Chief Justice of India reported that morphed photos of judges created using generative AI have been produced and circulated. The Supreme Court acknowledged these deepfake images while hearing a petition on establishing a regulatory framework for generative AI in the judiciary.
Reported impact
The creation and circulation of AI-generated morphed photos of judges represents a threat to the reputation and authority of the judicial system. The incident prompted the Supreme Court to consider regulatory measures to prevent similar misuse.
Index analysis
The misuse of generative AI to create deepfake images of judicial officers demonstrates the technology's dual-use potential when deployed without adequate governance controls. The incident occurred in the context of broader concerns about AI misuse in cyberattacks.
Governance controls
The Supreme Court of India is considering developing a regulatory framework specifically addressing generative AI use and misuse within the judiciary, in response to the reported incidents of morphed images.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.