Tasks50

Analog Design Bench

Benchmarking Agents on Hours-Long AMS Circuit Design Tasks

Tasks
50
Models
20

Leaderboard

1openaigpt-6-astra[max]
99%
Cost $3.60Out tok 29kSteps 30Agent time 23m
2anthropicclaude-opus-5-5[max]
97%
Cost $14.20Out tok 203kSteps 61Agent time 1h 03m
3anthropicclaude-fable-5[max]
78%
Cost $31.56Out tok 108kSteps 37Agent time 1h 20m
4anthropicclaude-opus-5[max]
69%
Cost $22.37Out tok 165kSteps 46Agent time 1h 23m
5openaigpt-5-6-sol[max]
68%
Cost $14.63Out tok 74kSteps 148Agent time 1h 08m
6openaigpt-5-5[xhigh]
61%
Cost $11.92Out tok 100kSteps 133Agent time 54m
7openaigpt-5-6-terra[max]
49%
Cost $8.22Out tok 115kSteps 178Agent time 1h 26m
8moonshotkimi-k3[max]
49%
Cost $5.52Out tok 133kSteps 75Agent time 1h 27m
9deepseekdeepseek-v4-1-flash[max]
47%
Cost $0.30Out tok 347kSteps 91Agent time 1h 42m
10deepseekdeepseek-v4-pro-0813[max]
42%
Cost $0.37Out tok 293kSteps 108Agent time 1h 33m
11xiaomimimo-v2-6-pro[thinking]
41%
Cost $0.38Out tok 217kSteps 86Agent time 1h 40m
12zhipuglm-5-3[max]
32%
Cost $2.91Out tok 237kSteps 58Agent time 1h 43m
13openaigpt-5-6-luna[max]
31%
Cost $1.39Out tok 133kSteps 216Agent time 1h 36m
14qwenqwen-3-8[xhigh]
30%
Cost $5.05Out tok 264kSteps 85Agent time 1h 44m
15bytedancedoubao-seed-evolving-0828[high]
26%
Cost $1.87Out tok 224kSteps 71Agent time 1h 50m
16zhipuglm-5-3-flash[max]
19%
Cost $0.49Out tok 382kSteps 70Agent time 1h 56m
17deepseekdeepseek-v4-flash-0731[max]
16%
Cost $0.12Out tok 191kSteps 84Agent time 1h 55m
18bytedancedoubao-seed-2-1-pro[high]
14%
Cost $3.34Out tok 63kSteps 56Agent time 1h 57m
19zhipuglm-5-2[max]
8%
Cost $1.57Out tok 101kSteps 39Agent time 1h 52m
20xiaomimimo-v2-5-pro[thinking]
8%
Cost $2.66Out tok 332kSteps 78Agent time 1h 44m