NHRC Probes AI Education Project Over Children's Data Privacy Risks
The National Human Rights Commission issued notices to Indian government departments and states over alleged risks to children's privacy in a collaboration between US company Anthropic and NGO Pratham that uses an AI system to process children's handwritten responses and academic data. The commission directed authorities to investigate potential vulnerabilities in data collection, processing, storage and cross-border transfer under India's data protection laws.
What happened
The National Human Rights Commission issued notices to all states and Union territories, as well as central government departments including the Ministry of Electronics and Information Technology, the Department of School Education and Literacy, and the Department of Higher Education, over alleged risks to children's privacy arising from a collaboration between US-based Anthropic and Pratham, an Indian NGO working with children.
The action followed a complaint filed by NAMO Foundation raising concerns about the 'Anytime Testing Machine (ATM)', an AI system used to process children's handwritten responses and academic data. The complainant alleged potential vulnerabilities relating to the collection, processing, storage and possible cross-border transfer of minors' personal data, raising concerns of data breach and inadequate safeguards under the Digital Personal Data Protection (DPDP) Act, 2023.
Reported impact
The NHRC bench presided by Member Priyank Kanoongo observed that the allegations, if true, prima facie indicate violations of human rights relating to privacy and protection of minors.
Index analysis
The complaint was titled 'Children's Privacy at Stake? Assessing Data Breach Risks in the Pratham–Anthropic AI Collaboration under India's DPDP Act', alleging that inadequate safeguards could compromise children's safety and data security.
Governance controls
The NHRC directed all Chief Secretaries and UT Administrators to inquire into the allegations and ensure that data collected by Pratham, Central Square Foundation, or any NGO working with or for governments is not misused and does not violate provisions of the DPDP Act, 2023 or any other Indian law.
The state governments have been asked to review Memoranda of Understanding (MoUs) or alliances entered into with such organisations. Separate notices were issued to the Ministry of Electronics and Information Technology, the Department of Higher Education, and the Department of School Education and Literacy, seeking reports on safeguards governing the use of AI systems in the education sector.
Classification
Sources and evidence
Sources not yet published
This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.