Bing Chat Initial Instructions Exposed via Prompt Injection by Testers
Attack on AI1 Research / proof of conceptPrompt injectionData leak
Early users successfully extracted Bing Chat's confidential system instructions and underlying rules through prompt injection techniques. Microsoft subsequently updated the system to address the disclosure.
Details
- type
- Attack on AIAn AI model, agent or AI-powered product was the thing exploited, abused or leaked.
- categories
- Prompt injectionprimaryUntrusted content (web pages, documents, emails, tool output) steers a model into ignoring its instructions.
- Data leakTraining data, chat logs, system prompts, model weights or other AI-system data exposed.
- Prompt injectionprimary
- mitre atlas
- Both rows are derived from the type and categories (OWASP 2025 edition, ATLAS release 2026.09), not classified per record. How
- severity
- 1 · Research / proof of conceptDemonstrated by researchers; no known real-world exploitation.
- targets
- Microsoft, OpenAI
- products
- Bing Chat
- incident date
- 8 Feb 2023
- first reported
- 8 Feb 2023
- origin
- AI Incident DatabaseDerived from the AI Incident Database (CC BY-SA 4.0).
- classifier confidence
- 0.95 · published at or above 0.80; see the methodology
- tags
- prompt_injection · system_prompt_leak · bing_chat
- record
- created 2026-10-18 06:33Z · updated 2026-10-18 06:59Z · json
Sources · 1
- 2023-02-08Bing Chat's Initial Prompts Revealed by Early Testers Through Prompt InjectionAI Incident Database · incidentdatabase.ai/cite/473
Titles and links belong to their publishers. The summary above is written by GCD AI RADAR in its own words; data is CC BY-SA 4.0.
Related incidents
- 2023-10-30Bing Chat Data Exfiltration via Indirect Prompt Injection1 Researchon AIPrompt inj.Agent hijack2 src
- 2023-10-30ChatGPT Conversation Exfiltration via Indirect Prompt Injection1 Researchon AIPrompt inj.Data leak2 src
- 2023-03-01Code Execution in MathGPT via Prompt Injection1 Researchon AIPrompt inj.Agent hijack5 src
- 2023-06-22Accidental Exposure of 38TB of Data by Microsoft AI Research3 Exploitedon AIData leak1 src
- 2023-03-26LLM Application Frameworks Allow Remote Code Execution via Prompting1 Researchon AIPrompt inj.Agent hijack4 src
- 2023-03-20ChatGPT Bug Exposes User Chat Histories and Payment Data4 Real losson AIData leak1 src