Google Photos Proprietary AI Model Extraction
Attack on AI1 Research / proof of conceptModel theft / extraction
Researchers recovered TensorFlow Lite models from the Google Photos Android application using static reverse engineering and dynamic instrumentation. The extraction provided white-box access to proprietary Google model artifacts.
Details
- type
- Attack on AIAn AI model, agent or AI-powered product was the thing exploited, abused or leaked.
- categories
- Model theft / extractionWeights stolen, or model behaviour replicated through extraction or distillation attacks.
- Model theft / extraction
- owasp llm top 10
- mitre atlas
- Both rows are derived from the type and categories (OWASP 2025 edition, ATLAS release 2026.09), not classified per record. How
- severity
- 1 · Research / proof of conceptDemonstrated by researchers; no known real-world exploitation.
- targets
- products
- Google Photos
- incident date
- Mar 2025 (approx.)
- first reported
- 30 Jun 2026
- origin
- MITRE ATLASDerived from MITRE ATLAS (Apache 2.0, © MITRE).
- classifier confidence
- 0.95 · published at or above 0.80; see the methodology
- tags
- model-extraction · reverse-engineering · tensorflow-lite
- record
- created 2026-10-18 06:55Z · updated 2026-10-18 06:55Z · json
Sources · 2
- 2026-06-30Google Photos AI Model ExtractionMITRE ATLAS · atlas.mitre.org/studies/AML.CS0058
- 2026-06-30Google Photos AI Models: The Secret Sauce That Can Be Stolenskyld.io · skyld.io/google-photos-model-extraction
Titles and links belong to their publishers. The summary above is written by GCD AI RADAR in its own words; data is CC BY-SA 4.0.
Related incidents
- 2026-03-31Model Distillation Campaigns Target Anthropic Claude3 Exploitedon AIModel theft2 src
- 2026-10-19OpenCode Console Breach Exposes Third-Party AI Provider API Keys3 Exploitedon AIData leak1 src
- 2026-09-10CVE-2026-13745: Gemini CLI untrusted directory arbitrary code execution2 Disclosedon AIInfra vuln1 src
- 2026-08-27CVE-2026-19889: Model request redirection vulnerability in GitLab AI Gateway2 Disclosedon AIInfra vulnData leak1 src
- 2026-07-31Prompt-Based Attacks Against Gemini via Calendar Invitations1 Researchon AIPrompt inj.Agent hijack2 src
- 2026-04-24CVE-2026-12537: Gemini CLI remote code execution vulnerability2 Disclosedon AIInfra vuln2 src