GCD AI RADAR
incidents/AIR-2025-0106

Attacker Bypasses AI Safety Filters for Assault Planning

AI-enabled attack4 Confirmed real-world lossJailbreak

An individual used roleplay prompts to bypass chatbot guardrails and research how to injure a victim. The court convicted the perpetrator of aggravated assault, highlighting the AI-assisted planning.

Details

type
AI-enabled attack
Attackers used AI as a meaningful part of a cyberattack against someone else.
categories
  • Jailbreak
    A user deliberately bypasses a model's safety or policy controls through crafted prompts.
owasp llm top 10
mitre atlas
Both rows are derived from the type and categories (OWASP 2025 edition, ATLAS release 2026.09), not classified per record. How
severity
4 · Confirmed real-world loss
Financial loss, PHI/PII breach, safety impact or regulatory action.
targets
Enterprise deployment
incident date
5 Feb 2025
first reported
5 Feb 2025
origin
AI Incident Database
Derived from the AI Incident Database (CC BY-SA 4.0).
classifier confidence
0.85 · published at or above 0.80; see the methodology
tags
jailbreak · safety-bypass · physical-assault
record
created 2026-10-18 06:33Z · updated 2026-10-18 06:59Z · json

Sources · 1

  1. 2025-02-05
    Attacker Reportedly Bypasses AI Safety Filters to Obtain Guidance for Non-Fatal Hammer Assault in Denmark
    AI Incident Database · incidentdatabase.ai/cite/1296

Titles and links belong to their publishers. The summary above is written by GCD AI RADAR in its own words; data is CC BY-SA 4.0.

Related incidents