Constraint-Guided Schematic Design on PCBSchemaGen 1.0 (test)
22Solved CountGPT-5.1
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| GPT-5.1Trials per task=152026.01 | 22 | — | — | 83.2 | |
| Gemini-3-FlashTrials per task=152026.01 | 22 | — | — | 88.1 | |
| Gemini-3-ProTrials per task=152026.01 | 22 | — | — | 86.1 | |
| DeepSeek-V3.2Trials per task=152026.01 | 21 | — | — | 73 | |
| GPT-OSS-120BTrials per task=152026.01 | 20 | — | — | 60 | |
| MiniMax-M2.1Trials per task=152026.01 | 19 | — | — | 48.7 | |
| Qwen3-MaxTrials per task=152026.01 | 17 | — | — | 51.3 | |
| Llama-4-MaverickTrials per task=152026.01 | 15 | — | — | 37.4 | |
| Llama3-70BTrials per task=152026.01 | 11 | — | — | 26.4 |