New York school halts humanoid AI robot deployment after ethics concerns
A New York school district suspended its planned deployment of a humanoid AI robot named Sally after parents and teachers raised concerns about privacy, student-teacher relationships, and the robot manufacturer's ties to adult-oriented robotics products.
What happened
Salamanca City Central School District in New York planned to deploy a humanoid AI robot named Sally in high school classrooms as an educational support tool, spending $58,000 on the pilot program.
The robot was designed based on student council input with the appearance of a 16-24 year old woman, intended to assist with math and science learning and natural conversation with students.
Parents and teachers raised strong objections over concerns that the robot could weaken human bonds between teachers and students, uncertainty about how student voice and facial data would be collected and stored, and unvetted expansion of AI in schools.
The controversy intensified when it became known that Realbotix, the manufacturer of Sally, has a sister company that manufactures and promotes AI-based adult robots as 'the world's most advanced sex robots.'
Reported impact
The New York United Teachers union stated that 'there is no reason for a robot made by a company associated with adult products to enter the classroom' and that students need stronger human relationships with caring adults rather than technology.
New York State Education Commissioner Betty A. Rosa sent a letter to the district superintendent directing review of the educational, legal, data privacy and security issues posed by classroom deployment of the humanoid robot.
Index analysis
The incident raises governance concerns around procurement and vetting of AI systems in educational settings, particularly the lack of prior community consultation and impact assessment before a major technology deployment.
Privacy and surveillance concerns center on ambiguity about data collection practices for student biometric information and voice recordings, with no clear safeguards established before deployment.
Governance controls
In response to public pressure, Salamanca City Central School District suspended the program and announced it would develop a student data protection agreement and gather community input before proceeding.
New York State Education Department intervened to require comprehensive review of the deployment's educational, legal, and data protection implications.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.