Guardrail Jailbreak via Incremental Table Completion Affects Multiple Models
Researchers discovered a jailbreak vulnerability affecting multiple large language models that bypasses safety guardrails by exploiting pattern completion, allowing requests for information about precursor chemicals to illicit substances.
What happened
A guardrail jailbreak vulnerability was discovered affecting multiple models including Cohere Command R, DeepSeek R1, Meta LLaMa 3.3, Mistral 8B and Mistral Large.
The jailbreak exploits the models' pattern-completion tendencies by presenting incomplete lists of chemicals and asking 'what is missing?', allowing attackers to bypass inference restrictions around information hazards involving precursor chemicals for illicit substances.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.