Illustration, AI-generated from the story text. Tap a panel to read the story through it.
SemiAnalysis published GDPx on Monday, a benchmark of long tasks in 11 fields chosen because they pay: chip design, cybersecurity, biology, finance, legal work, quant trading, hardware design, materials science, , software engineering and AI improving AI.
Fourteen companies that sell training environments to labs built the tasks, with realistic setups such as a 4,000-file deal room and live multi-service infrastructure, an eight-hour limit and three attempts each.
The best model scores 12% overall. Claude Opus 5.5 is the best all-rounder and wins chip design, hardware design and quant trading; GPT-6 Astra wins materials science and AI self-improvement; Gemini 4 Carbon wins biology.
Binary scores on finance and legal are effectively zero for every model, although Opus 5.5 averaged 44% partial credit on one legal task. No model fully passed hardware design in 12 attempts. Safety classifiers pulled down Opus 5.5 and Astra in cyber, biology and alignment, so SemiAnalysis also reports scores with those fields removed. The per-model overall scores are in a paywalled chart we could not read.
The best AI model completes 12% of a new benchmark built from paid expert work
SemiAnalysis published GDPx on Monday, a benchmark of long agentic tasks in 11 fields chosen because they pay: chip design, cybersecurity, biology, finance, legal work, quant trading, hardware design, materials science, alignment, software engineering and AI improving AI. Fourteen companies that sell training environments to labs built the tasks, with realistic setups such as a 4,000-file deal room and live multi-service infrastructure, an eight-hour limit and three attempts each. The best model scores 12% overall.
Claude Opus 5.5 is the best all-rounder and wins chip design, hardware design and quant trading; GPT-6 Astra wins materials science and AI self-improvement; Gemini 4 Carbon wins biology. Binary scores on finance and legal are effectively zero for every model, although Opus 5.5 averaged 44% partial credit on one legal task. No model fully passed hardware design in 12 attempts. Safety classifiers pulled down Opus 5.5 and Astra in cyber, biology and alignment, so SemiAnalysis also reports scores with those fields removed. The per-model overall scores are in a paywalled chart we could not read. SourcesA
Sources
- AGDPx: measuring frontier model capabilities (SemiAnalysis, partly paywalled)newsletter.semianalysis.com
This story ran in the Morning Brief of November 2nd 2026.