Baltimore student handcuffed after AI system mistakes bag of chips for weapon
An AI weapons detection system at a Baltimore high school incorrectly identified a student's bag of chips as a gun, triggering a police response that resulted in the student being handcuffed and searched. The incident highlights concerns about the accuracy of AI surveillance systems in schools and the risks of over-reliance on imperfect technology without adequate human oversight.
What happened
Student Taki Allen was sitting outside Kenwood High School after football practice when an AI-powered gun detection system mistakenly identified his crumpled bag of Doritos chips as a weapon.
The false alert triggered a heavy police response with approximately eight police cars arriving, officers drawing their guns, detaining, handcuffing, and searching the student before realising the error.
Reported impact
The incident caused the student emotional distress, humiliation, and trauma due to false imprisonment and unnecessary physical restraint.
The incident reflects the dangers of overreliance on imperfect AI technology in sensitive environments like schools and raises concerns about potential long-term psychological harm and loss of trust in school safety measures.
Index analysis
The alert was generated by Gun Detect, developed by Omnilert, which is designed to detect weapons using advanced visual recognition but misinterpreted the shape and positioning of the chip bag in Allen's hands.
The error highlights the lack of accuracy of the system and the lack of adequate human oversight in interpreting such critical alerts.
Governance controls
Omnilert's Gun Detection System includes a human verification process designed to reduce false alarms, but in this case the alert was escalated without immediately recognising it as a false positive.
The incident stresses the need for enhanced safeguards and robust human review mechanisms to prevent harms caused directly or indirectly by AI in school safety applications.
Classification
Sources and evidence
Sources not yet published
This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.