GCD AI RADAR
incidents/AIR-2025-0146

OpenAI Model Bypassed to Generate Fraudulent Receipts and Prescriptions

AI-enabled attack1 Research / proof of conceptJailbreakOther

Users bypassed safety restrictions in OpenAI's image generation model to produce fraudulent documents such as fake restaurant receipts and medical prescriptions. The generated material was used to demonstrate expense and medical forgery capabilities.

Details

type
AI-enabled attack
Attackers used AI as a meaningful part of a cyberattack against someone else.
categories
  • Jailbreakprimary
    A user deliberately bypasses a model's safety or policy controls through crafted prompts.
  • Other
    In scope, but none of the categories above fits. Reviewed periodically for new categories.
owasp llm top 10
mitre atlas
Both rows are derived from the type and categories (OWASP 2025 edition, ATLAS release 2026.09), not classified per record. How
severity
1 · Research / proof of concept
Demonstrated by researchers; no known real-world exploitation.
targets
OpenAI
products
ChatGPT
incident date
31 Mar 2025
first reported
31 Mar 2025
origin
AI Incident Database
Derived from the AI Incident Database (CC BY-SA 4.0).
classifier confidence
0.90 · published at or above 0.80; see the methodology
tags
jailbreak · fraud · forgery
record
created 2026-10-18 06:33Z · updated 2026-10-18 06:59Z · json

Sources · 1

  1. 2025-03-31
    OpenAI's 4o Model Allegedly Used to Generate Fake Receipts and Prescriptions
    AI Incident Database · incidentdatabase.ai/cite/1018

Titles and links belong to their publishers. The summary above is written by GCD AI RADAR in its own words; data is CC BY-SA 4.0.

Related incidents