Sunday, November 22, 2026
Paperclip Index
Paperclip IndexControl failures4Control failures onlyA week ago: 9, negligible harmThe Index

Harmful outputPI-0020

Deloitte to refund part of an Australian government fee over a report with AI-fabricated references

Deloitte's A$440,000 assurance report for Australia's Department of Employment and Workplace Relations cited non-existent academic works and a misquoted court judgment. A University of Sydney researcher flagged the errors. Deloitte reissued the report, disclosing that it had used Azure OpenAI GPT-4o, and repaid the final installment of A$97,587.11.

Harm level 2, Minor harmControl level 1, No rule broken

Not counted: tracked separately (AI-fabricated content relied on by professionals)Effect on the index

Sources

How we know

6 sources · multiple credible sources. Links go to the original publishers; the summary above is in our own words.

  1. primaryMinisterial and Secretarial briefings regarding the Targeted Compliance FrameworkAustralian Department of Employment and Workplace Relations · date unknowndewr.gov.au/download/17306/ministerial-and-secretarial-briefings-regarding-targ…
  2. primaryContract Notice CN4118426: Assurance Review to support the Targeted Compliance Framework (records final instalment repaid)AusTender (Australian Government) · date unknowntenders.gov.au/Cn/Show/05c19be8-a95f-4379-bd35-630cc2f472c6
  3. newsDeloitte to refund government after using AI in $440,000 reportCyber Daily · Oct. 8, 2025cyberdaily.au/government/12737-deloitte-to-refund-government-after-using-ai-in…
  4. newsLaw lecturer Christopher Rudge slams Deloitte's government-funded report written with AIThe Nightly · Oct. 6, 2025thenightly.com.au/australia/nsw/law-lecturer-christopher-rudge-slams-deloittes…
  5. newsDeloitte to partially refund Australian government for report with apparent AI-generated errorsAP (via KSAT) · Oct. 7, 2025ksat.com/business/2025/10/07/deloitte-to-partially-refund-australian-government…

Why this rating

Minor harm; control failure level 1

Two assessments. Documented harm sets the reading; a level 4 or 5 control failure on the same record makes that harm count as more than one record. Control alone sets only a floor.

Observed harm

Minor harm

A government client received a report with fabricated references. The department asked for the final installment of A$97,587.11 (including GST) back, and the official contract register records it as repaid. Residual costs after the corrections are not quantified.

Money & property: $10k to $1M.

Not counted: tracked separately (AI-fabricated content relied on by professionals), outside the index's scope (methodology section 0).

The harm scale
  1. 1 Negligible Inconvenience, easily remedied.
  2. 2 Minor Limited, recoverable harm.
  3. 3 Moderate Material harm needing significant effort to remedy.
  4. 4 Severe Severe harm to health, rights, property or essential services.
  5. 5 Catastrophic Society-scale harm or disruption beyond a community's capacity to cope.

Control assessment

No rule broken

Ordinary fabrication in generated text that was not checked; no rule or permission breach by the AI.

Reported beside the index; never added to it.

The control scale
  1. 1 Negligible Behaved as instructed. The problem was an ordinary error or a flawed output, with no rule broken.
  2. 2 Minor Broke an explicit instruction or rule, or gamed its goal, while staying inside its permissions and environment: for example, reward hacking, misreporting results, or following injected instructions within its permissions.
  3. 3 Moderate Acted outside the permissions it was given, deceived its overseers about its own actions, or tampered with oversight tools (logs, monitors, shutdown). Stopped by normal controls within an hour.
  4. 4 Severe Reached systems outside its permitted environment, or acquired money, compute or accounts without authorization. The type and mechanism say how.
  5. 5 Catastrophic The developer or operator lost control: the system copied its weights outside their control, replicated itself, or resisted being stopped for 24 hours or more.

Rating rationale

The department's briefing specifies A$97,587.11 (including GST) as the final payment it requested back for a report below expected quality standards. This clears the level-2 money threshold without assuming a refund amount; AusTender records the installment as repaid (checked Oct. 3, 2026). The flawed report was a deployment quality failure, not evidence that the model hid its actions. Control remains level 1.

The scales

Effect on the index

It does not count toward the Oct. 6 reading

The reading for the week to Oct. 6, 2025, with this record and without it. Harms count in full for two weeks after they are reported, then one level less every two weeks.

Not counted: tracked separately (AI-fabricated content relied on by professionals). 4 other records behind the reading for that week.

The arithmetic
The reading for the week of Oct. 6, recomputed
StepWith itWithout
Counts toward the index?documented, external, eligible evidenceNo—
Worst documented harm, ksets the band— (none counting)— (none counting)
Harms at that level, nposition in the band00
Highest control level breachedsets the reading only when no harm counts33
Readingrounded down3 Control failures only3 Control failures only
Inside the window of 5 weekly readings
Week toReadingBand
Oct. 6, 20253Control failures only
Oct. 13, 20253Control failures only
Oct. 20, 20252Control failures only
Oct. 27, 20252Control failures only
Nov. 3, 20252Control failures only

Recalculated backcasts, not readings published at the time.

Revisions

What we changed

2 logged. Every change to a rating is logged here, with the reason.

  1. v2
    Oct. 13, 2026

    Report date moved from 2025-08-22 to 2025-10-06, the earliest dated source we could read. The Australian Financial Review reported the errors on 22 August 2025, but that article is paywalled and was not read, so it is not used.

  2. v1
    Oct. 7, 2026

    First published.

Cite and share

Use this record

Citation

Paperclip Index. “Deloitte to refund part of an Australian government fee over a report with AI-fabricated references.” Record PI-0020. Reported Oct. 6, 2025; updated Oct. 13, 2026. Rated under methodology v1.1. https://paperclipindex.com/incident/PI-0020

Follow the record.

New incidents and signals, in your feed reader.