Circuit Design on Circuit Design Tasks 30 Benchmark
100Metric 1 ScoreAnalogAgent
Evaluation results
| Method | Links | ||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AnalogAgentBackbone=Qwen3-4B, Metric=Pass@12026.03 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 86.7 | 100 | 100 | 100 | 100 | 93.3 | 83.3 | 0 | 0 | 0 | 66.7 | 0 | 0 | 0 | 0 | 0 | 0 | 93.3 | 70 | 0 | 76.7 | 100 | — | — | 62.3 | 66.6667 | |
| AnalogAgentBackbone=Qwen3-4B, Metric=Pass@52026.03 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 99.9 | 0 | 0 | 0 | 99.8 | 0 | 0 | 0 | 0 | 0 | 0 | 100 | 99.9 | 0 | 99.9 | 100 | — | 66.7 | — | 66.6667 | |
| AnalogAgentBackbone=Qwen3-8B, Metric=Pass@12026.03 | 100 | 100 | 100 | 100 | 93.3 | 100 | 96.7 | 100 | 96.7 | 100 | 90 | 100 | 100 | 80 | 96.7 | 0 | 76.7 | 63.3 | 100 | 0 | 0 | 50 | 33.3 | 0 | 0 | 100 | 93.3 | 0 | 93.3 | 100 | — | — | 72.1 | 80 | |
| AnalogAgentBackbone=Qwen3-8B, Metric=Pass@52026.03 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 99.9 | 100 | 0 | 99.9 | 99.8 | 100 | 0 | 0 | 97.3 | 89.1 | 0 | 0 | 100 | 100 | 0 | 100 | 100 | — | 79.5 | — | 80 | |
| Qwen3-14BBackbone=Qwen3-14B, Metric=Pass@52026.03 | 100 | 16.7 | 100 | 100 | 100 | 100 | 100 | 99.1 | 97.9 | 100 | 99.7 | 99.9 | 99.7 | 94 | 100 | 0 | 0 | 43.3 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 70.2 | 31 | — | 51.7 | — | 60 | |
| AnalogCoder-ProBackbone=Qwen3-14B, Metric=Pass@52026.03 | 100 | 98.6 | 91.8 | 100 | 85.7 | 97.9 | 97.9 | 43.3 | 16.7 | 16.7 | 81.5 | 89.1 | 76.4 | 53.8 | 70.2 | 0 | 0 | 76.4 | 16.7 | 0 | 31 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | — | 39.9 | — | 60 | |
| AnalogAgentBackbone=Qwen3-14B, Metric=Pass@12026.03 | 100 | 100 | 100 | 100 | 100 | 93.3 | 100 | 100 | 96.7 | 80 | 73.3 | 100 | 86.7 | 80 | 100 | 66.7 | 0 | 100 | 70 | 66.7 | 33.3 | 100 | 83.3 | 0 | 0 | 100 | 73.3 | 0 | 96.7 | 100 | — | — | 76.7 | 86.6667 | |
| AnalogAgentBackbone=Qwen3-14B, Metric=Pass@52026.03 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 99.8 | 0 | 100 | 99.9 | 99.8 | 89.1 | 100 | 100 | 0 | 0 | 100 | 100 | 0 | 100 | 100 | — | 85.7 | — | 86.6667 | |
| AnalogCoder-ProBackbone=Qwen3-4B, Metric=Pass@52026.03 | 99.9 | 99.7 | 0 | 100 | 16.7 | 100 | 100 | 100 | 0 | 16.7 | 100 | 100 | 97.9 | 100 | 70.2 | 0 | 0 | 0 | 16.7 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | — | 37.3 | — | 46.6667 | |
| AnalogAgentBackbone=Qwen3-1.7B, Metric=Pass@52026.03 | 98.6 | 0 | 0 | 99.1 | 89.1 | 99.9 | 16.7 | 89.1 | 0 | 100 | 95.5 | 99.9 | 43.3 | 99.9 | 99.9 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 98.6 | 0 | 0 | 0 | 0 | — | 37.7 | — | 43.3333 | |
| Qwen3-8BBackbone=Qwen3-8B, Metric=Pass@52026.03 | 93.9 | 16.7 | 81.2 | 99.5 | 81.5 | 95.5 | 99.1 | 100 | 16.7 | 98.6 | 97.3 | 96.6 | 0 | 99.9 | 99.8 | 0 | 0 | 99.5 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | — | 42.5 | — | 50 | |
| Qwen3-14BBackbone=Qwen3-14B, Metric=Pass@12026.03 | 90 | 3.3 | 96.7 | 83.3 | 93.3 | 83.3 | 96.7 | 56.7 | 50 | 76.7 | 63.3 | 70 | 63.3 | 40 | 90 | 0 | 0 | 10 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 20 | 6.7 | — | — | 35.3 | 60 | |
| AnalogCoder-ProBackbone=Qwen3-8B, Metric=Pass@52026.03 | 89.1 | 95.7 | 91.8 | 100 | 89.1 | 94 | 94 | 100 | 0 | 31 | 94 | 99.1 | 97.9 | 99.8 | 99.4 | 0 | 0 | 85.7 | 16.7 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | — | 45.9 | — | 53.3333 | |
| Qwen3-4BBackbone=Qwen3-4B, Metric=Pass@52026.03 | 76.4 | 0 | 0 | 99.1 | 0 | 99.8 | 100 | 100 | 85.7 | 100 | 100 | 99.8 | 93.9 | 99.9 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 100 | 81.5 | — | 41.2 | — | 43.3333 | |
| AnalogCoder-ProBackbone=Qwen3-14B, Metric=Pass@12026.03 | 73.3 | 53.3 | 36.7 | 83.3 | 30 | 50 | 50 | 10 | 3.3 | 3.3 | 26.7 | 33.3 | 23.3 | 13.3 | 20 | 0 | 0 | 23.3 | 3.3 | 0 | 6.7 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | — | — | 18.1 | 60 | |
| AnalogCoder-ProBackbone=Qwen3-4B, Metric=Pass@12026.03 | 70 | 63.3 | 0 | 73.3 | 3.3 | 100 | 83.3 | 93.3 | 0 | 3.3 | 83.3 | 86.7 | 50 | 100 | 20 | 0 | 0 | 0 | 3.3 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | — | — | 27.8 | 46.6667 | |
| AnalogAgentBackbone=Qwen3-1.7B, Metric=Pass@12026.03 | 53.3 | 0 | 0 | 56.7 | 33.3 | 80 | 3.3 | 33.3 | 0 | 90 | 43.3 | 83.3 | 10 | 76.7 | 80 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 53.3 | 0 | 0 | 0 | 0 | — | — | 22.2 | 43.3333 | |
| Qwen3-8BBackbone=Qwen3-8B, Metric=Pass@12026.03 | 40 | 3.3 | 26.7 | 60 | 26.7 | 43.3 | 56.7 | 96.7 | 3.3 | 53.3 | 50 | 46.7 | 0 | 70 | 63.3 | 0 | 0 | 60 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | — | — | 23.3 | 50 | |
| AnalogCoder-ProBackbone=Qwen3-8B, Metric=Pass@12026.03 | 33.3 | 43.3 | 36.7 | 90 | 33.3 | 40 | 40 | 96.7 | 0 | 6.7 | 40 | 56.7 | 50 | 66.7 | 60 | 0 | 0 | 30 | 3.3 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | — | — | 24.2 | 53.3333 | |
| Qwen3-4BBackbone=Qwen3-4B, Metric=Pass@12026.03 | 23.3 | 0 | 0 | 56.7 | 0 | 66.7 | 86.7 | 100 | 30 | 100 | 93.3 | 66.7 | 40 | 70 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 86.7 | 26.7 | — | — | 28.2 | 43.3333 | |
| Qwen3-1.7BBackbone=Qwen3-1.7B, Metric=Pass@12026.03 | 0 | 0 | 0 | 3.3 | 3.3 | 3.3 | 3.3 | 0 | 0 | 13.3 | 13.3 | 3.3 | 3.3 | 23.3 | 3.3 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | — | — | 2.4 | 33.3333 | |
| Qwen3-1.7BBackbone=Qwen3-1.7B, Metric=Pass@52026.03 | 0 | 0 | 0 | 16.7 | 16.7 | 16.7 | 16.7 | 0 | 0 | 53.8 | 53.8 | 16.7 | 16.7 | 76.4 | 16.7 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | — | 10 | — | 33.3333 | |
| AnalogCoder-ProBackbone=Qwen3-1.7B, Metric=Pass@12026.03 | 0 | 0 | 0 | 3.3 | 10 | 0 | 0 | 3.3 | 0 | 0 | 26.7 | 10 | 6.7 | 53.3 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | — | — | 3.8 | 23.3333 | |
| AnalogCoder-ProBackbone=Qwen3-1.7B, Metric=Pass@52026.03 | 0 | 0 | 0 | 16.7 | 43.3 | 0 | 0 | 16.7 | 0 | 0 | 81.5 | 43.3 | 31 | 98.6 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | — | 11 | — | 23.3333 |