PCB Schematic Design Generation on PCB schematic dataset (test)
82Pass RatioSchGen
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| SchGenNumber of parameters=20 billion2026.05 | 82 | 7.73 | 49.08 | 54.87 | 52.8 | 6 | 0.61 | 60.5 | |
| GPT-5.2Code representation=L32026.05 | 68.03 | 9.55 | 41.06 | 43.38 | 46.71 | — | — | — | |
| GPT-5.2Code representation=L12026.05 | 67.89 | 8.56 | 42.95 | 45.72 | 49.51 | 11 | 0.94 | 50 | |
| Grok-4Code representation=L12026.05 | 61.21 | 8.82 | 44.03 | 49.77 | 48.73 | 20 | 1.19 | 47 | |
| GPT-o4miniCode representation=L32026.05 | 60.91 | 8.61 | 34.97 | 36.74 | 37.13 | — | — | — | |
| GPT-o4miniCode representation=L12026.05 | 59.7 | 9.4 | 32.25 | 34.62 | 37.71 | 43 | 1.23 | 37 | |
| GPT-5.2Code representation=L22026.05 | 59.26 | 11.12 | 35.53 | 37.53 | 40.14 | — | — | — | |
| GPT-o4miniCode representation=L22026.05 | 59.04 | 8.92 | 33.62 | 34.94 | 35.07 | — | — | — | |
| Grok-4Code representation=L32026.05 | 53.13 | 9.98 | 35.88 | 37.8 | 37.26 | — | — | — | |
| Grok-4Code representation=L22026.05 | 52.07 | 10.69 | 32.74 | 34.56 | 34.14 | — | — | — | |
| Vanilla GPT-oss 20bNumber of parameters=20b2026.05 | 10.99 | 18.37 | 9.48 | 9.6 | 9.6 | 75 | 2.21 | 17 | |
| GPT-5.2Code representation=KiCad2026.05 | 10.53 | — | 0.53 | 0.88 | 0.88 | — | — | — | |
| GPT-o4miniCode representation=KiCad2026.05 | 5.96 | — | 0 | 0 | 0 | — | — | — | |
| Grok-4Code representation=KiCad2026.05 | 3.95 | — | 1.32 | 1.32 | 1.32 | — | — | — |