Questions

AI breach response: your questions answered

Sourced answers to the questions that come up when an AI tool, its logs or its storage have exposed data.

Last reviewed against legislation.gov.uk, National Cyber Security Centre and OWASP GenAI Security Project. Sources

Green padlock with a blue tick resting on a hexagonal plinth

Next

Where to read on

Facing a live incident? Open the first response steps. Preparing in advance? The seven actions set out the order of work.

Quick answers

Questions people ask

Do I have to report an AI data breach?

If personal data is involved, UK GDPR expects the regulator to be told promptly, and where practicable within 72 hours of you becoming aware[1]. You need not report a breach that is unlikely to put anyone's rights and freedoms at risk, but you must still write it up[1].

When does the 72 hours start?

It runs from the moment the controller becomes aware of the breach[1]. Note when and how you were told, because a notice that goes later has to explain the delay[1].

What must the report to the regulator include?

As a minimum: the nature of the breach with approximate numbers of people and records, a contact point, the expected consequences and the measures taken or proposed[1]. If the full picture is not ready, details can follow in stages[1].

Do we have to tell the people affected?

Only where the breach puts them at high risk, and then promptly and in plain language[2]. Exceptions include data that was protected, for example by encryption[2].

Is it our breach if our AI supplier is breached?

It can be. A processor has to alert the controller promptly once it knows[1], and the controller's own target runs from when it becomes aware[1]. Ask the supplier what of yours was affected and in which systems.

Do we need to record a breach we decide not to report?

Yes. Every breach must be written up with the facts, the effects and the remedial action taken[1].

What happened in the DeepSeek database case?

Wiz found an unprotected ClickHouse database holding more than a million log lines, among them conversations and secret keys[7]. Wiz reported the problem to DeepSeek, which closed the exposure quickly[7].

Was ChatGPT breached in 2023?

OpenAI traced an incident to a bug in the redis-py library. Some users saw other people's chat titles, and payment-related details of roughly 1.2% of Plus subscribers who used the service in a nine-hour stretch were visible[9]. It said complete card numbers were never exposed[9].

What does the NCSC say about responding to AI incidents?

It expects organisations to hold a suitable response plan for incidents involving AI, and wants leaders to understand their data, model and software supply chains[3]. Its secure AI development guidelines list incident management processes under secure deployment[4].

Can an AI tool leak personal data in its answers?

OWASP says LLM applications can give away personal details, health and money records, trade secrets and credentials through their outputs[5]. Treat such a disclosure as a possible personal data breach and assess it.

How CyPro can help

Need a hand working through this?

Finding out whether an incident reaches you is one job. Checking your own systems, tightening access and briefing the board are several more. CyPro's responders and consultants can take any of them on.

Incident responders containing an attack

Incident response

If you may already be compromised, our responders contain it, preserve the evidence, find out what was touched and get you running again safely.

More on cypro.co.uk
Security analysts monitoring systems around the clock

24/7 security monitoring

Our SOC analysts watch your systems day and night for the signs of an attack in progress: unexpected processes, new outbound connections, logins that do not fit.

More on cypro.co.uk
Security lead advising a board

Fractional CISO for the board

A senior security lead who advises the board on what to fix first, what to accept and what to tell customers, and owns the decision record.

More on cypro.co.uk
Penetration tester probing an application for weaknesses

Penetration testing

A focused test of your systems and the controls around them, so you know they hold before an attacker finds out for you.

More on cypro.co.uk
Cyber security consultants planning hardening work

Hardening and segmentation

Our consultants put the controls in place that limit the damage when something is missed: firewall rules, network isolation and tighter admin access.

More on cypro.co.uk
Scanner checking internet-facing systems for weaknesses

Vulnerability scanning

Find every internet-facing system you run, including the forgotten ones, and see which are still on a vulnerable build.

See the scanning service
Rocket launching from a cloud

Talk to a specialist

Worried this affects you?

When data has leaked through an AI tool, its logs or its storage, the early decisions shape what you must report and to whom. An incident response team helps you contain the exposure, establish what was involved and prepare your notifications.