An AI-based gun-detection system triggered an alert that led armed officers to handcuff a 16-year-old Baltimore student who was holding a bag of chips, not a weapon, according to local reports and police statements. Baltimore County Police said officers acted on information at hand and the situation was resolved without an arrest after no threat was found. The school’s principal said the alert was reviewed and canceled internally, but a subsequent call to a school resource officer prompted a broader police response, highlighting gaps in protocol.
Omnilert, the system’s provider, said the tool functioned as designed, with human reviewers quickly assessing the image before passing it to the district’s safety team. The incident has spurred calls from local officials to review procedures surrounding AI-driven surveillance in schools. It comes amid broader scrutiny of weapon-detection and facial-recognition technologies, including prior actions against firms for overstating accuracy, underscoring the risks of false positives, operational missteps, and potential civil-rights concerns as schools expand security tech.
Related articles:
— NIST Study Evaluates Effects of Race, Age, Sex on Face Recognition Software
— The Perpetual Line-Up: Unregulated Police Face Recognition in America
