Worked example: a briefing note due in forty minutes

Hallucination and unreliability · 8 min read

Lesson 21 of 60
In this module

It is 16:20. A compliance officer needs a two-page note for a 17:00 meeting on what the organisation must do about AI transparency obligations. She asks an assistant tool for a summary and gets back something clean, structured and immediately usable. Forty minutes is not enough to verify everything. What does she do?

The output

Four paragraphs. It states that transparency obligations under the EU AI Act apply from 2 August 2026. It says deployers of deepfakes must disclose. It says there is a grace period for marking systems already on the market. It says Switzerland's data protection law requires breach notification within 72 hours. It cites "Article 50(4)" and "Article 24 revFADP". It adds a figure: that most organisations are not yet ready.

Triage, not verification

She does not read it as a document to approve or reject. She marks it up by risk shape, which takes ninety seconds.

Dates and numbers: 2 August 2026, the grace period, 72 hours. Circled.

Citations: Article 50(4), Article 24 revFADP. Circled.

The negative and the statistic: "most organisations are not yet ready". Circled, and for a different reason: it is a claim about the world with no visible source.

Everything else: the structure, the framing, the explanation of why a disclosure duty exists. Left alone. That material is scaffolding and reasoning, not assertion, and it is the part the tool is genuinely good at.

What checking actually looks like

She checks the circled items against the organisation's own verified source list, which exists precisely so that this check takes minutes rather than an afternoon.

Article 50 applying from 2 August 2026 is confirmed, and the note is correct that this date was not deferred. The marking grace period for systems placed on the market before that date ending 2 December 2026 is confirmed. Article 50(4) deepfake disclosure is confirmed.

The 72-hour figure is wrong. Article 24 of the revised Swiss Federal Act on Data Protection requires notification to the FDPIC as soon as possible. There is no 72-hour deadline in Swiss law. The model produced it because 72 hours is what usually follows "breach notification" in the material it learned from, and it attached that to a Swiss article number without any mechanism that could have objected. This is the single most instructive line in the whole output: a correct instrument, a correct article, and a number imported from a different legal system.

The readiness statistic is not on the verified list, and cannot be traced. She deletes it. Not softens it, deletes it. A sentence you cannot support does not become supportable by adding "reportedly".

What goes in the note

The structure survives. The three confirmed items survive with their article references. The Swiss sentence is rewritten to say what the law says: notification as soon as possible, with no fixed deadline, and a point that this is often assumed to mirror the GDPR and does not. The statistic is gone. Total time spent: about twelve minutes.

The habits that made forty minutes enough

Triage by shape before reading for sense. Circling numbers, citations and negatives is mechanical and takes under two minutes on two pages. Reading critically for an hour catches less, because fluent wrong sentences do not read as wrong.

A verified source list that already exists. This is the thing that makes checking cheap. Built after the deadline arrives, it is useless. Maintained in advance, it converts verification from research into lookup.

Delete rather than hedge. Unsupported claims that survive as hedged claims are the mechanism by which a fabrication enters the organisation's record and gets cited back six months later.

Leave the low-risk material alone. The reason this process survives deadline pressure is that it is narrow. She verified five things, not forty.

The record

The note carries a line saying which tool produced the first draft and that factual claims were checked against the verified source list. That line costs nothing and it is what an Article 14 oversight arrangement looks like when it is real rather than declared.

As of 24 September 2026.

Sign in to save your progress

You can read every lesson without an account. Signing in keeps your place and unlocks the assessment.