Overview

Responding to a data breach involving AI

A breach involving AI is handled like any other personal data breach, and the UK target of 72 hours still applies. What changes is where you look: prompts, chat history, keys and storage.

Last reviewed against legislation.gov.uk, National Cyber Security Centre and OWASP GenAI Security Project. Sources

At a glance

72 hours
UK GDPR target for notifying the regulator, counted from becoming aware of the breach[1]
13%
of surveyed organisations reported an attack affecting their AI models or applications[6]
97%
of breached organisations with an AI-related security incident lacked proper AI access controls[6]
38 TB
of private data exposed in one AI research storage account[8]

The latest

AI Breach Response: what has happened so far

Newest first. Each entry links to its source.

Latest

Wiz reports an open DeepSeek database[7]

Wiz said a publicly accessible ClickHouse database with no authentication held chat history and secret keys. DeepSeek secured it promptly after disclosure.

NCSC publishes guidance for leaders on AI and cyber security[3]

The guidance tells organisations to have a response plan for AI-related incidents and to understand their supply chains.

NCSC publishes secure AI development guidelines[4]

Version 1.0 covers secure design, development, deployment and operation, and lists incident management processes under secure deployment.

The full timeline

In brief

Three answers first

This is a pattern of incidents rather than a single event. These are the three questions most readers arrive with.

Tall blue server rack with glowing status lights

What it is

Data from or about an AI tool ends up somewhere it should not be. OWASP's list of LLM risks names personal details, health and money records, trade secrets and login credentials as things such an application can give away [5]. The cause may be a bug, an open database, a careless link or a member of staff.

Wi-Fi signal above a hexagonal padlock

Whether it affects you

If staff use AI tools, or a supplier handles your data with them, the question is open. IBM reports that 13% of the organisations it surveyed had suffered an attack touching their AI systems [6]. In 2023 Samsung limited staff use of generative AI after source code was pasted into ChatGPT, according to a company memo reported by the press [10].

Factory site linked by wireless to a phone with a fingerprint and shield

What to do first

Write down when you became aware, because the reporting target is measured from then [1]. Next follow the first response steps, then work through the seven actions.

Public cases

What has already happened

Three well documented cases with three different causes.

Green padlock with a blue tick resting on a hexagonal plinth

A software bug

OpenAI traced a March 2023 exposure to a flaw in redis-py, an open-source library. Payment-related details of roughly 1.2% of Plus subscribers who used the service during a nine-hour stretch were visible [9]. Read the cases in detail.

Industrial site map with viruses hovering over buildings marked in red

An open database

Wiz came across an unprotected DeepSeek database: more than a million log lines, among them conversations and secret keys [7]. See exposed AI storage.

Green shield with a tick above a phone showing a fingerprint

An over-broad link

A shared storage link published by Microsoft AI researchers opened up about 38 TB of private data, including backups and internal messages [8]. See leaked keys and tokens.

Start here

The one thing to do first

Record the time you became aware

UK GDPR expects the regulator to hear about a reportable breach promptly, and where practicable within 72 hours of you becoming aware [1]. Every later decision rests on that note being accurate.

Am I affected?

Answer a few questions

Check if you are affected

Three questions on whether you could respond well to an AI-related breach today. Nothing you answer leaves this page.

If a supplier told you tomorrow that data from an AI tool you use had leaked, would you not know who decides whether it must be reported?

Based on [1][8][3]. Nothing you enter leaves this page.

Quick answers

Questions people ask

Do I have to report an AI data breach?

If personal data is involved, UK GDPR expects the regulator to be told promptly, and where practicable within 72 hours of you becoming aware[1]. You need not report a breach that is unlikely to put anyone's rights and freedoms at risk, but you must still write it up[1].

When does the 72 hours start?

It runs from the moment the controller becomes aware of the breach[1]. Note when and how you were told, because a notice that goes later has to explain the delay[1].

What must the report to the regulator include?

As a minimum: the nature of the breach with approximate numbers of people and records, a contact point, the expected consequences and the measures taken or proposed[1]. If the full picture is not ready, details can follow in stages[1].

Do we have to tell the people affected?

Only where the breach puts them at high risk, and then promptly and in plain language[2]. Exceptions include data that was protected, for example by encryption[2].

Every question, answered

About this site

Primary sources, dated

The CyPro Consulting Ltd team maintains this site. Every version, date and figure comes from 7 named sources, including legislation.gov.uk, National Cyber Security Centre, OWASP GenAI Security Project, and links to the one it came from. Last checked 4 November 2026.

Who we are and how pages are kept current

How CyPro can help

Need a hand working through this?

Finding out whether an incident reaches you is one job. Checking your own systems, tightening access and briefing the board are several more. CyPro's responders and consultants can take any of them on.

Incident responders containing an attack

Incident response

If you may already be compromised, our responders contain it, preserve the evidence, find out what was touched and get you running again safely.

More on cypro.co.uk
Security analysts monitoring systems around the clock

24/7 security monitoring

Our SOC analysts watch your systems day and night for the signs of an attack in progress: unexpected processes, new outbound connections, logins that do not fit.

More on cypro.co.uk
Security lead advising a board

Fractional CISO for the board

A senior security lead who advises the board on what to fix first, what to accept and what to tell customers, and owns the decision record.

More on cypro.co.uk
Penetration tester probing an application for weaknesses

Penetration testing

A focused test of your systems and the controls around them, so you know they hold before an attacker finds out for you.

More on cypro.co.uk
Cyber security consultants planning hardening work

Hardening and segmentation

Our consultants put the controls in place that limit the damage when something is missed: firewall rules, network isolation and tighter admin access.

More on cypro.co.uk
Scanner checking internet-facing systems for weaknesses

Vulnerability scanning

Find every internet-facing system you run, including the forgotten ones, and see which are still on a vulnerable build.

See the scanning service
Rocket launching from a cloud

Talk to a specialist

Worried this affects you?

When data has leaked through an AI tool, its logs or its storage, the early decisions shape what you must report and to whom. An incident response team helps you contain the exposure, establish what was involved and prepare your notifications.