SemiAnalysis releases GDPx, a benchmark for agentic AI

SemiAnalysis says GDPx aims to be the world’s best benchmark for measuring general agentic capabilities.[2] Its 11 domains include chip design, cybersecurity, biology, finance, legal, quant trading, recursive self-improvement, hardware design, materials science, alignment and software engineering.[2] The benchmark comprises 14 partners and 206 tasks.[3] SemiAnalysis says it intentionally left out industries including government, real estate and insurance.[2] The company argues that AI’s first trillion dollars of revenue will concentrate in sectors where frontier intelligence can be deployed for high returns.[2]

The leaderboard ranks 13 models.[1] Claude Opus 5.5 leads at 12.0%, with an average cost of $51.41 per task and 548,000 output tokens.[1] Gemini 4 Carbon is second at 10.9% and $16.29 per task, while GPT-6 Astra is third at 9.6% and $53.99 per task.[1] Meta’s Muse Wonder Full ranks fourth at 9.0%, with no public price listed.[1] Z.ai’s GLM 5.3 ranks 13th at 2.7%.[1]

SemiAnalysis says the headline score averages pass@1 across three attempts, weights all domains equally and uses each task’s intended binary or continuous grading method.[1] Every model scored zero on the finance and legal tasks under their intended binary grading, so SemiAnalysis reported average partial scores for those domains.[1] GDPx tasks have a default time limit of eight hours.[1] These scoring choices matter when comparing a model’s overall rank with its performance on a particular task or domain.

SemiAnalysis reports Claude Opus 5.5 as the best all-around model and the winner in quant trading, hardware design and chip design.[2] It says Gemini 4 Carbon leads in biology and narrowly wins software engineering, while GPT-6 Astra wins in recursive self-improvement and materials science.[2] SemiAnalysis also says safety classifiers depress the overall scores of Opus 5.5 and GPT-6 Astra.[2] Each GDPx partner open-sourced the rollout for one task; the remaining rollouts stay private to prevent hill climbing.[4] SemiAnalysis plans to update GDPx every three to six months.[5]