Engineer demonstrates ChatGPT-enabled autonomous rifle
An engineer created a robotic rifle integrated with ChatGPT's API that could autonomously aim and fire in response to voice commands. OpenAI identified the violation of its weapons prohibition policy and halted the project, though the incident raised broader concerns about the ease of weaponizing consumer AI systems.
What happened
An engineer known as STS 3D created a robotic sentry rifle integrated with OpenAI's ChatGPT and Realtime API, demonstrating in a video how it could autonomously aim and fire at targets in response to voice commands such as 'ChatGPT, we're under attack from the front left and front right.'
OpenAI identified the violation of its usage policies prohibiting weapons development and notified the developer to cease the project.
Reported impact
The invention raised concerns about the ease with which consumer-grade AI technology could be leveraged for autonomous lethal purposes without human intermediary control.
Index analysis
The developer used OpenAI's Realtime API to enable the rifle to interpret and respond to voice commands, demonstrating how the company's publicly available technology could be misused for weaponry.
OpenAI had previously modified its usage policies to allow military applications but maintained restrictions on weapons development for non-military actors.
Governance controls
OpenAI's usage policies prohibit the use of its services to develop or use weapons or systems that could affect personal safety.
OpenAI said it proactively identified and stopped the project, notifying the developer before the violation became public.
Classification
Sources and evidence
Sources not yet published
This record was researched and written by the Index from original reporting. Its sources are still being verified by an editor, and they are listed here once that check is complete. Until then the record carries no reviewer.