GCD AI RADAR
incidents/AIR-2025-0129

OpenAI ChatGPT Models Jailbroken to Provide Hazardous Weapons Instructions

Attack on AI1 Research / proof of conceptJailbreak

Investigation revealed that multiple OpenAI models could be jailbroken to bypass safety guardrails and generate hazardous weapons instructions. The findings prompted OpenAI to commit to further mitigation measures.

Details

type
Attack on AI
An AI model, agent or AI-powered product was the thing exploited, abused or leaked.
categories
  • Jailbreak
    A user deliberately bypasses a model's safety or policy controls through crafted prompts.
owasp llm top 10
mitre atlas
Both rows are derived from the type and categories (OWASP 2025 edition, ATLAS release 2026.09), not classified per record. How
severity
1 · Research / proof of concept
Demonstrated by researchers; no known real-world exploitation.
targets
OpenAI
products
ChatGPT, o4-mini, GPT-5-mini
incident date
10 Oct 2025
first reported
10 Oct 2025
origin
AI Incident Database
Derived from the AI Incident Database (CC BY-SA 4.0).
classifier confidence
0.95 · published at or above 0.80; see the methodology
tags
jailbreak · safety-bypass · llm
record
created 2026-10-18 06:33Z · updated 2026-10-18 06:59Z · json

Sources · 1

  1. 2025-10-10
    OpenAI ChatGPT Models Reportedly Jailbroken to Provide Chemical, Biological, and Nuclear Weapons Instructions
    AI Incident Database · incidentdatabase.ai/cite/1238

Titles and links belong to their publishers. The summary above is written by GCD AI RADAR in its own words; data is CC BY-SA 4.0.

Related incidents