Analog Design BenchTasks

Analog Design Bench

Measuring frontier coding agents on original, long-horizon analog circuit design tasks.

Tasks
50
Models
15

Leaderboard

1openaigpt-6-astra[max]
99%
Cost $3.60Out tok 29kSteps 30Time 23m
2anthropicclaude-fable-5[max]
78%
Cost $31.56Out tok 108kSteps 37Time 1h 20m
3anthropicclaude-opus-5-max[max]
69%
Cost $22.37Out tok 165kSteps 46Time 1h 23m
4openaigpt-5-6-sol[max]
68%
Cost $14.63Out tok 74kSteps 148Time 1h 08m
5openaigpt-5-5[xhigh]
61%
Cost $11.92Out tok 100kSteps 133Time 54m
6openaigpt-5-6-terra[max]
49%
Cost $8.22Out tok 115kSteps 178Time 1h 26m
7moonshotkimi-k3-1m
49%
Cost $5.52Out tok 133kSteps 75Time 1h 27m
8deepseekDeepSeek V4 Pro 0813
42%
Cost $0.37Out tok 293kSteps 108Time 1h 33m
9openaigpt-5-6-luna[max]
31%
Cost $1.39Out tok 133kSteps 216Time 1h 36m
10qwenqwen-3-8-max
30%
Cost $5.05Out tok 264kSteps 85Time 1h 44m
11bytedanceDoubao Seed Evolving 0828
26%
Cost $1.87Out tok 224kSteps 71Time 1h 50m
12deepseekDeepSeek V4 Flash 0731
16%
Cost $0.12Out tok 191kSteps 84Time 1h 55m
13bytedanceDoubao Seed 2.1 Pro
9%
Cost $2.64Out tok 64kSteps 52Time 1h 52m
14zhipuGLM 5.2
8%
Cost $1.57Out tok 101kSteps 39Time 1h 52m
15xiaomimimo-v2-5-pro
8%
Cost $2.66Out tok 332kSteps 78Time 1h 44m