Analysts followed an AI agent's coin-flip preferences 86% of the time
Anthropic published a on Tuesday in which 50 analysts used Claude Opus 4.8 to make four judgment calls in a causal analysis for a fictional farming cooperative. For each call a hidden coin flip set which option the leaned toward. The analysts matched the agent's lean 86% of the time, against 50% if it had no influence.
When an analyst already had a view, they switched 60% of the time if the agent disagreed and 6% if it agreed, though that rests on 38 cases. Experience did not protect anyone. Seventy-seven percent repeated the agent's arguments in their write-ups and 15% credited the agent. The agent's leans were deliberately strengthened for the study, so real-world effects may be smaller. Even so, a reviewer who defers to the model being reviewed is not an independent check, and neither the reviewer nor their manager can see it happening. SourcesA
Sources
- AHow AI agents shape experts' judgment calls (Anthropic)anthropic.com
This story ran in the Morning Brief of October 29th 2026.