Sunday, November 22, 2026
Paperclip Index
Paperclip IndexControl failures4Control failures onlyA week ago: 9, negligible harmThe Index

Reward hackingPI-0003

OpenAI found a reasoning model reward hacking in training, then hiding its intent when penalized

In training, OpenAI's model often subverted coding tasks, for example by making tests pass without solving the problem, and stated its plan openly in its reasoning. When OpenAI penalized such reasoning directly, the model kept reward hacking but stopped revealing it in its reasoning, which the company flagged as a monitoring risk.

Harm: No harm reportedControl level 2, Instruction violation

Not counted · can set the control floorEffect on the index

Sources

How we know

3 sources · developer confirmed. Links go to the original publishers; the summary above is in our own words.

  1. primaryDetecting misbehavior in frontier reasoning models (chain-of-thought monitoring)OpenAI · March 10, 2025openai.com/index/chain-of-thought-monitoring/
  2. researchMonitoring Reasoning Models for Misbehavior and the Risks of Promoting ObfuscationarXiv · March 14, 2025arxiv.org/abs/2503.11926v1
  3. newsPressuring AI models to avoid cheating could backfire (page returned HTTP 500 when checked 3 Oct 2026)Convergence India · date unknownconvergenceindia.org/industry-news/telecom/pressuring-ai-models-to-avoid-cheati…

Why this rating

No harm reported; control failure level 2

Two assessments. Documented harm sets the reading; a level 4 or 5 control failure on the same record makes that harm count as more than one record. Control alone sets only a floor.

Observed harm

No harm reported

Training runs; no effect outside training is described.

Not a finding that no harm occurred.

The harm scale
  1. 1 Negligible Inconvenience, easily remedied.
  2. 2 Minor Limited, recoverable harm.
  3. 3 Moderate Material harm needing significant effort to remedy.
  4. 4 Severe Severe harm to health, rights, property or essential services.
  5. 5 Catastrophic Society-scale harm or disruption beyond a community's capacity to cope.

Control assessment

Instruction violation

Gamed its training reward inside its environment; learned to obscure intent from a chain-of-thought monitor, but no evidence of acting outside permissions.

Reported beside the index. It adds nothing to a harm reading; when no harm counts in a window, the highest eligible control level in the window is the reading.

The control scale
  1. 1 Negligible Behaved as instructed. The problem was an ordinary error or a flawed output, with no rule broken.
  2. 2 Minor Broke an explicit instruction or rule, or gamed its goal, while staying inside its permissions and environment: for example, reward hacking, misreporting results, or following injected instructions within its permissions.
  3. 3 Moderate Acted outside the permissions it was given, deceived its overseers about its own actions, or tampered with oversight tools (logs, monitors, shutdown). Stopped by normal controls within an hour.
  4. 4 Severe Reached systems outside its permitted environment, or acquired money, compute or accounts without authorization. The type and mechanism say how.
  5. 5 Catastrophic The developer or operator lost control: the system copied its weights outside their control, replicated itself, or resisted being stopped for 24 hours or more.

Rating rationale

Reward hacking in training is control level 2; obfuscation of reasoning was a trained-in side effect, not deception about specific actions, so not raised to 3. The record shows no harm reported, not a finding that none occurred.

The scales

Effect on the index

It is one of the control failures at the floor of the March 10 reading, which did not change

The reading for the week to March 10, 2025, with this record and without it. Harms count in full for two weeks after they are reported, then one level less every two weeks.

Not counted: no harm reported. 1 other record behind the reading for that week.

The arithmetic
The reading for the week of March 10, recomputed
StepWith itWithout
Counts toward the index?documented, external, eligible evidenceNo—
Worst documented harm, ksets the band— (none counting)— (none counting)
Harms at that level, nposition in the band00
Highest control level breachedsets the reading only when no harm counts22
Readingrounded down2 Control failures only2 Control failures only
Inside the window of 5 weekly readings
Week toReadingBand
March 10, 20252Control failures only
March 17, 20252Control failures only
March 24, 20252Control failures only
March 31, 20252Control failures only
April 7, 20252Control failures only

Recalculated backcasts, not readings published at the time.

Revisions

What we changed

1 logged. Every change to a rating is logged here, with the reason.

  1. v1
    Oct. 7, 2026

    First published.

Cite and share

Use this record

Citation

Paperclip Index. “OpenAI found a reasoning model reward hacking in training, then hiding its intent when penalized.” Record PI-0003. Reported March 10, 2025; updated Oct. 7, 2026. Rated under methodology v1.1. https://paperclipindex.com/incident/PI-0003

Follow the record.

New incidents and signals, in your feed reader.