Post
3768
Hey all ā our ResearchClawBench leaderboard just updated š„
We let AI do real science: 40 tasks across 10 disciplines, compared to human papers. Hard example? šļø Glacier mass change ā AI must integrate 233 datasets from 35 teams, 4 methods, reproduce 6542±387 Gt ice loss vs IPCC. No toy problems.
Latest leaderboard (2026-06-09) š:
Agents: š„ Claude Code 21.5 (50 = match human), $5.3; š„ EvoScientist 18.8, $4.1; š„ Codex CLI 18.4, just $2.0
LLMs+Harness: š„ Claude-Opus-4.8 21.1, $4.0; š„ Claude-Opus-4.7 20.7; š„ MiniMax-M3 19.8, only $0.45; Qwen3.7-Max 18.7, $0.42, 11min š„
Claude still king, but MiniMax/Qwen/DeepSeek are crazy cheap and competitive. Expensive isn't always better.
š Code & star: https://github.com/InternScience/ResearchClawBench
š Website: https://internscience.github.io/ResearchClawBench-Home/
š¤ Upvote paper: ResearchClawBench: A Benchmark for End-to-End Autonomous Scientific Research (2606.07591)
We let AI do real science: 40 tasks across 10 disciplines, compared to human papers. Hard example? šļø Glacier mass change ā AI must integrate 233 datasets from 35 teams, 4 methods, reproduce 6542±387 Gt ice loss vs IPCC. No toy problems.
Latest leaderboard (2026-06-09) š:
Agents: š„ Claude Code 21.5 (50 = match human), $5.3; š„ EvoScientist 18.8, $4.1; š„ Codex CLI 18.4, just $2.0
LLMs+Harness: š„ Claude-Opus-4.8 21.1, $4.0; š„ Claude-Opus-4.7 20.7; š„ MiniMax-M3 19.8, only $0.45; Qwen3.7-Max 18.7, $0.42, 11min š„
Claude still king, but MiniMax/Qwen/DeepSeek are crazy cheap and competitive. Expensive isn't always better.
š Code & star: https://github.com/InternScience/ResearchClawBench
š Website: https://internscience.github.io/ResearchClawBench-Home/
š¤ Upvote paper: ResearchClawBench: A Benchmark for End-to-End Autonomous Scientific Research (2606.07591)