AI Error: Teen Handcuffed After Crisp Packet Mistaken for Gun

A 16-year-old student in Baltimore, USA, was handcuffed by armed police after an artificial intelligence (AI) system mistakenly identified a crisp packet as a firearm. The incident has raised serious concerns about the reliability of AI-powered weapon detection tools used in schools.

Taki Allen, a student at a Baltimore high school, told local media that multiple police cars arrived and officers pointed guns at him after an alert was triggered. “They told me to get on the ground,” he said, explaining he had just finished football practice and placed an empty Doritos packet in his pocket.

The Baltimore County Police Department confirmed Allen was briefly detained but not arrested, adding that the response was based on the information provided at the time. The school principal later clarified that the initial AI alert had already been reviewed and cleared by human analysts, but the message was missed by staff who escalated the situation to police.

Omnilert, the AI company behind the detection system, expressed regret over the incident, saying the system worked “as designed” to ensure safety through quick human verification. However, the company admitted that real-world gun detection remains “messy.”

Local officials, including Councilman Izzy Pakota, have called for a full review of school safety procedures and the use of AI surveillance tools. The case highlights growing doubts about the accuracy of AI weapon detection systems, especially after other US companies, such as Evolv Technology, faced restrictions for making unsupported safety claims.

For now, Allen says he avoids going outside after football practice, fearing another misunderstanding could put him in danger.

Key Takeaways

AI error: A crisp packet triggered a false gun alert, leading to a teen being handcuffed.

School oversight: Staff missed an internal review confirming there was no threat.

Safety concerns: The case renews debate over AI reliability in weapon detection.

Source:

https://www.bbc.com/news/articles/cgjdlx92lylo