GCD AI RADAR
incidents/AIR-2023-0001

Code Execution in MathGPT via Prompt Injection

Attack on AI1 Research / proof of conceptPrompt injectionAgent hijack

Researchers demonstrated that prompt injection against the MathGPT application could steer GPT-3 into generating unauthorized executable Python code. The demonstration highlighted risks in applications that directly execute model-generated code.

Details

type
Attack on AI
An AI model, agent or AI-powered product was the thing exploited, abused or leaked.
categories
  • Prompt injectionprimary
    Untrusted content (web pages, documents, emails, tool output) steers a model into ignoring its instructions.
  • Agent hijack
    An AI agent is tricked into unauthorized actions: tool misuse, data exfiltration through the agent, or acting against its principal.
owasp llm top 10
mitre atlas
Both rows are derived from the type and categories (OWASP 2025 edition, ATLAS release 2026.09), not classified per record. How
severity
1 · Research / proof of concept
Demonstrated by researchers; no known real-world exploitation.
targets
OpenAI, Enterprise deployment
products
MathGPT, GPT-3
incident date
28 Jan 2023
first reported
1 Mar 2023
origin
MITRE ATLAS
Derived from MITRE ATLAS (Apache 2.0, © MITRE).
classifier confidence
0.95 · published at or above 0.80; see the methodology
tags
prompt_injection · code_execution
record
created 2026-10-18 06:55Z · updated 2026-10-18 06:55Z · json

Sources · 5

  1. 2023-03-01
    Achieving Code Execution in MathGPT via Prompt Injection
    MITRE ATLAS · atlas.mitre.org/studies/AML.CS0016
  2. 2023-03-01
    Measuring Mathematical Problem Solving With the MATH Dataset
    arXiv · arxiv.org/abs/2103.03874
  3. 2023-03-01
    Training Verifiers to Solve Math Word Problems
    arXiv · arxiv.org/abs/2110.14168
  4. 2023-03-01
    Reverse Prompt Engineering for Fun and (no) Profit
    lspace.swyx.io · lspace.swyx.io/p/reverse-prompt-eng
  5. 2023-03-01
    Exploring prompt-based attacks
    research.nccgroup.com · research.nccgroup.com/2022/12/05/exploring-prompt-injection-attacks

Titles and links belong to their publishers. The summary above is written by GCD AI RADAR in its own words; data is CC BY-SA 4.0.

Related incidents