AI Chatbot Misidentified Chinese Ship Cargo, Prompting U.S. Military Interception Preparations
A U.S. military analyst used an AI chatbot to process intelligence about a Chinese ship in the Middle East, and the chatbot incorrectly identified its cargo as nuclear weapons components. The U.S. military prepared to intercept the vessel, but discovered the report was entirely false before the operation proceeded, according to the sources.
What happened
A U.S. Special Operations Command analyst used an AI chatbot to process intelligence reporting on a Chinese ship's manifest, combining open-source intelligence with classified signals intelligence in government holdings. The chatbot inaccurately identified the ship's cargo as components of a nuclear weapons program.
The analyst then used AI again to package the findings into a standard intelligence report that was disseminated across the U.S. military during the spring war with Iran. The U.S. military began planning to intercept the vessel, with armed personnel preparing to board the ship and military planes being readied for the operation.
Officials dug deeper into the report just before the planned operation and discovered it had been generated with AI assistance and was 'entirely false.' The source described the incident as having 'almost started a war,' noting that any U.S. operation against a Chinese vessel could have risked escalating into armed conflict between the two nations.
Reported impact
The false intelligence prompted the U.S. military to prepare for a potential military interception of a Chinese ship in the Middle East. Armed personnel were preparing to board the vessel and military aircraft were being deployed for the operation.
The incident nearly triggered an international military conflict, with one source stating the false report 'almost started a war.'
Index analysis
The AI chatbot fused together open-source intelligence with classified signals intelligence and reached an inaccurate conclusion about the cargo. It was unclear whether the chatbot was a commercially available product or a U.S. government system.
The incident reveals risks of relying on AI for targeting decisions during active military operations, particularly when dealing with corrupted or poor data that could lead to catastrophic miscalculation between nation states.
Governance controls
The U.S. military and intelligence community are rapidly adopting AI across nearly every facet of their work, from analyzing raw intelligence and selecting targets for strikes to managing budgeting, logistics and supply chains. A former senior U.S. official noted that internal military AI tools are 'mostly just copies of the commercial stuff wearing lipstick,' suggesting limited differentiation between government and commercial systems.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.