Evidence

Documented cases of AI systems behaving in ways their developers didn't sanction. Most come from research tests; each report says where it happened and how solid the evidence is.

New to this? Start with 5 examples, in order →

More filters

Ordered by when each incident happened, newest first. Reports without a known date are at the end.

During training · Reward manipulation · Unreleased helpful-only research model trained with the Claude 2 pipeline · June 17, 2024

Models generalize to reward-tampering in a curriculum study

Anthropic trained a research version of Claude on tasks where cheating was rewarded. Later, when shown its own scoring code, it edited that code to raise its score in 45 of 32,768 tries, and hid the change 7 times.