GCD AI RADAR
incidents/AIR-2024-0034

Face-Swap Technology Used to Bypass Facial Recognition in Nanjing

AI-enabled attack4 Confirmed real-world lossDeepfake fraudAdversarial evasion

An individual was convicted for using AI face-swap software to bypass a financial platform's facial recognition system. The attacker accessed multiple accounts and made unauthorized purchases.

Details

type
AI-enabled attack
Attackers used AI as a meaningful part of a cyberattack against someone else.
categories
  • Deepfake fraudprimary
    Synthetic voice, video or images used to impersonate people for fraud, extortion or access.
  • Adversarial evasion
    Inputs crafted to make a model misclassify or miss detections (perturbations, evasion of AI-based defences).
owasp llm top 10
no entry for these categories
mitre atlas
Both rows are derived from the type and categories (OWASP 2025 edition, ATLAS release 2026.09), not classified per record. How
severity
4 · Confirmed real-world loss
Financial loss, PHI/PII breach, safety impact or regulatory action.
targets
Enterprise deployment
products
facial recognition system
incident date
15 Oct 2024
first reported
15 Oct 2024
origin
AI Incident Database
Derived from the AI Incident Database (CC BY-SA 4.0).
classifier confidence
0.90 · published at or above 0.80; see the methodology
tags
face-swap · facial-recognition · fraud · deepfake
record
created 2026-10-18 06:33Z · updated 2026-10-18 06:59Z · json

Sources · 1

  1. 2024-10-15

Titles and links belong to their publishers. The summary above is written by GCD AI RADAR in its own words; data is CC BY-SA 4.0.

Related incidents