GCD AI RADAR
incidents/AIR-2024-0001

Leonardo AI Moderation Bypassed for Nonconsensual Deepfakes

Attack on AI3 Confirmed exploitationJailbreak

Users exploited Leonardo AI's text-to-image generator by using custom prompts to bypass content moderation systems. The platform was allegedly used to create nonconsensual sexual images of public figures.

Details

type
Attack on AI
An AI model, agent or AI-powered product was the thing exploited, abused or leaked.
categories
  • Jailbreak
    A user deliberately bypasses a model's safety or policy controls through crafted prompts.
owasp llm top 10
mitre atlas
Both rows are derived from the type and categories (OWASP 2025 edition, ATLAS release 2026.09), not classified per record. How
severity
3 · Confirmed exploitation
Used against real targets; limited or unclear impact.
targets
Enterprise deployment
products
Leonardo AI
incident date
26 Mar 2024
first reported
26 Mar 2024
origin
AI Incident Database
Derived from the AI Incident Database (CC BY-SA 4.0).
classifier confidence
0.85 · published at or above 0.80; see the methodology
tags
moderation-bypass · deepfake · image-generation
record
created 2026-10-18 06:33Z · updated 2026-10-18 06:59Z · json

Sources · 1

  1. 2024-03-26
    Leonardo AI's Platform Alleged to Have Been Used for Creating Nonconsensual Celebrity Deepfakes
    AI Incident Database · incidentdatabase.ai/cite/661

Titles and links belong to their publishers. The summary above is written by GCD AI RADAR in its own words; data is CC BY-SA 4.0.

Related incidents