Verilog Code Generation on VerilogEval Machine v1
82.9Pass@1QiMeng-CRUX-Final-7B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| QiMeng-CRUX-Final-7BType=Verilog-Specific General Models2025.11 | 82.9 | 88.3 | 90.2 | |
| Deepseek-R1-671BType=Foundation Reasoning Models2025.11 | 81 | 87.4 | 89.5 | |
| Deepseek-V3-671BType=Foundation General Models2025.11 | 77.6 | 86.2 | 87.4 | |
| CodeV-Qwen1.5-7BType=Verilog-Specific General Models2025.11 | 77.6 | 88.2 | 90.7 | |
| HaVen-7BType=Verilog-Specific Reasoning Models2025.11 | 77.3 | 81.2 | — | |
| CodeV-Qwen2.5-7BType=Verilog-Specific General Models2025.11 | 77.3 | 87.9 | 90.1 | |
| QiMeng-CRUX-SFT-7BType=Verilog-Specific General Models2025.11 | 76.8 | 87.3 | 91.8 | |
| CodeV-R1-7BType=Verilog-Specific Reasoning Models2025.11 | 76.5 | 84.1 | 85.7 | |
| CodeV-R1-Distill-7BType=Verilog-Specific Reasoning Models2025.11 | 76.2 | 85.6 | 87 | |
| OriGen-7BType=Verilog-Specific General Models2025.11 | 74.1 | 82.4 | 85.7 | |
| VeriPrefer-7BType=Verilog-Specific General Models2025.11 | 72.7 | 85.8 | — | |
| QWQ-32BType=Foundation Reasoning Models2025.11 | 71.1 | 84 | 87 | |
| GPT-4oType=Foundation General Models2025.11 | 67.7 | 75.5 | 77.2 | |
| Qwen2.5-Coder-32BType=General Code Models2025.11 | 66.6 | 76.6 | 79.7 | |
| RTLCoder-6.7BType=Verilog-Specific General Models2025.11 | 61.2 | 76.5 | 81.8 | |
| Deepseek-Coder-6.7BType=General Code Models2025.11 | 52.2 | 55.4 | 56.8 | |
| Qwen2.5-Coder-7BType=General Code Models2025.11 | 50.1 | 66.5 | 70.9 |