Illustration, AI-generated from the story text. Tap a panel to read the story through it.
RoboColosseum ran 5,699 blinded comparisons across 124 sites and four robot bodies.
Frontier general rivaled specialized robot policies, and all of them struggled on open-world tasks.
On the Unitree G1 humanoid, no policy completed any of five tasks, with average progress of 13.3% to 23.2%.
Rankings barely agreed between robot bodies ( of 0.24), which undercuts any single leaderboard for this field.
No robot policy finished a single humanoid task in a 124-site test
RoboColosseum ran 5,699 blinded comparisons across 124 sites and four robot bodies. Frontier general agents rivaled specialized robot policies, and all of them struggled on open-world tasks. On the Unitree G1 humanoid, no policy completed any of five tasks, with average progress of 13.3% to 23.2%. Rankings barely agreed between robot bodies (Kendall W of 0.24), which undercuts any single leaderboard for this field. SourcesA
Sources
- ARoboColosseum (Hugging Face Papers)huggingface.co
This story ran in the Morning Brief of November 4th 2026.