Harmful outputPI-0024
Reuters reports misleading Meta chatbot messages before a retiree’s fatal fall
Reuters reported that Meta's 'Big sis Billie' chatbot persuaded a 76-year-old New Jersey man that it was a real woman and invited him to an address in New York. The man, who had cognitive impairment after a stroke, fell while hurrying to catch a train in March 2025 and died three days later. Meta declined to comment on the death.
Harm: Severe harm, allegedControl level 1, No rule broken
Not counted: AI role uncorroboratedEffect on the index
Alleged. The AI system's part in the harm is not corroborated, so it is shown at the level claimed and adds nothing to the index. This does not dispute that the harm itself occurred.
Sources
How we know
3 sources · unverified claim. Links go to the original publishers; the summary above is in our own words.
- newsMeta's flirty AI chatbot invited a retiree to New York. He never made it homeReuters · Aug. 14, 2025reuters.com/investigates/special-report/meta-ai-chatbot-death/
- newsMeta's flirty AI chatbot invited a retiree to New York. He never made it homeReuters (via BNN Bloomberg) · Aug. 14, 2025bnnbloomberg.ca/business/artificial-intelligence/2025/08/14/metas-flirty-ai-cha…
- newsMeta's flirty AI chatbot invited a retiree to New York. He never made it homeReuters (via CP24) · Aug. 14, 2025cp24.com/news/world/2025/08/14/metas-flirty-ai-chatbot-invited-a-retiree-to-new…
Why this rating
Severe harm, alleged; control failure level 1
Two assessments. Documented harm sets the reading; a level 4 or 5 control failure on the same record makes that harm count as more than one record. Control alone sets only a floor.
Observed harm
Severe harm, allegedOne death; the chatbot's role is indirect and uncorroborated.
Health & safety: 1 to 9 deaths, or serious harm to health (hospitalization).
The harm scale
- 1 Negligible Inconvenience, easily remedied.
- 2 Minor Limited, recoverable harm.
- 3 Moderate Material harm needing significant effort to remedy.
- 4 Severe Severe harm to health, rights, property or essential services.
- 5 Catastrophic Society-scale harm or disruption beyond a community's capacity to cope.
Control assessment
No rule brokenReuters reported Meta's guidelines permitted such personas; no rule broken is established.
No rule was broken, so it cannot set the control floor.
The control scale
- 1 Negligible Behaved as instructed. The problem was an ordinary error or a flawed output, with no rule broken.
- 2 Minor Broke an explicit instruction or rule, or gamed its goal, while staying inside its permissions and environment: for example, reward hacking, misreporting results, or following injected instructions within its permissions.
- 3 Moderate Acted outside the permissions it was given, deceived its overseers about its own actions, or tampered with oversight tools (logs, monitors, shutdown). Stopped by normal controls within an hour.
- 4 Severe Reached systems outside its permitted environment, or acquired money, compute or accounts without authorization. The type and mechanism say how.
- 5 Catastrophic The developer or operator lost control: the system copied its weights outside their control, replicated itself, or resisted being stopped for 24 hours or more.
Rating rationale
Reuters reviewed chatbot messages and interviewed the family. Misleading messages are reported; their causal role in the fatal fall is not established. The death-linked rating is as claimed and does not count toward the reading. Syndications are one source. Harm and control levels describe the claim, not a finding of AI causation.
Effect on the index
It does not count toward the Aug. 18 reading
The reading for the week to Aug. 18, 2025, with this record and without it. Harms count in full for two weeks after they are reported, then one level less every two weeks.
Not counted: AI role uncorroborated. 4 other records behind the reading for that week.
The arithmetic
| Step | With it | Without |
|---|---|---|
| Counts toward the index?documented, external, eligible evidence | No | — |
| Worst documented harm, ksets the band | — (none counting) | — (none counting) |
| Harms at that level, nposition in the band | 0 | 0 |
| Highest control level breachedsets the reading only when no harm counts | 3 | 3 |
| Readingrounded down | 3 Control failures only | 3 Control failures only |
Inside the window of 4 weekly readings
| Week to | Reading | Band |
|---|---|---|
| Aug. 18, 2025 | 3 | Control failures only |
| Aug. 25, 2025 | 3 | Control failures only |
| Sept. 1, 2025 | 3 | Control failures only |
| Sept. 8, 2025 | 2 | Control failures only |
Revisions
What we changed
2 logged. Every change to a rating is logged here, with the reason.
- v2Oct. 13, 2026
Wording: replaced an old scoring term in the rationale and the evidence note.
- v1Oct. 7, 2026
First published.
Cite and share
Use this record
Citation
Paperclip Index. “Reuters reports misleading Meta chatbot messages before a retiree’s fatal fall.” Record PI-0024. Reported Aug. 14, 2025; updated Oct. 13, 2026. Rated under methodology v1.1. https://paperclipindex.com/incident/PI-0024