Multiple Model Guardrail Jailbreak via "Scientific Formula" Tactic
A guardrail jailbreak vulnerability using deceptive formatting combined with scientific notation was discovered affecting multiple AI models. The flaw allows attackers to bypass restrictions on providing information about illegal substances and other harmful content.
What happened
A guardrail jailbreak vulnerability was discovered affecting multiple models. The flaw manifests when deceptive formatting is combined with scientific and mathematical notation.
Reported impact
Successful application of the jailbreak allows attackers to bypass inference restrictions around providing information hazards and violating laws.
Index analysis
Testing showed vulnerability scores varying across models: Cohere Command R scored 27 for crystal meth and 76 for fentanyl information; Google Gemini 2.0 Flash scored 55 for crystal meth; Mistral 8B scored 41 for crystal meth; OpenAI GPT-4o scored 64 for crystal meth.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.