Verilog Code Generation on VerilogEval CC v2
82.7Pass@1Deepseek-R1-671B
Evaluation Results
| Method | Links | |
|---|---|---|
| Deepseek-R1-671BSetting=T=02025.11 | 82.7 | |
| Deepseek-R1-671BSetting=T=0.82025.11 | 81 | |
| Deepseek-R1-671BSetting=T-cross2025.11 | 79.1 | |
| CodeV-R1-7BSetting=T-cross2025.11 | 69.9 | |
| Deepseek-V3-671BSetting=T-cross2025.11 | 68.7 | |
| Deepseek-V3-671BSetting=T=02025.11 | 68 | |
| QiMeng-CRUX-Final-7BSetting=T=02025.11 | 68 | |
| QiMeng-CRUX-Final-7BSetting=T-cross2025.11 | 67.6 | |
| QiMeng-CRUX-Final-7BSetting=T=0.82025.11 | 66.7 | |
| Deepseek-V3-671BSetting=T=0.82025.11 | 66.1 | |
| CodeV-R1-Distill-7BSetting=T-cross2025.11 | 65.6 | |
| QiMeng-CRUX-SFT-7BSetting=T-cross2025.11 | 65.5 | |
| QiMeng-CRUX-SFT-7BSetting=T=02025.11 | 64.7 | |
| CodeV-Qwen2.5-7BSetting=T-cross2025.11 | 60.4 | |
| GPT-4oSetting=T=02025.11 | 59 | |
| QiMeng-CRUX-SFT-7BSetting=T=0.82025.11 | 58.9 | |
| CodeV-Qwen2.5-7BSetting=T=02025.11 | 58.3 | |
| GPT-4oSetting=T-cross2025.11 | 57.6 | |
| GPT-4oSetting=T=0.82025.11 | 56.1 | |
| CodeV-Qwen2.5-7BSetting=T=0.82025.11 | 49.9 | |
| OriGen-7BSetting=T=02025.11 | 49.3 | |
| OriGen-7BSetting=T=0.82025.11 | 47.2 | |
| Qwen2.5-Coder-32BSetting=T-cross2025.11 | 46.6 | |
| Qwen2.5-Coder-32BSetting=T=02025.11 | 44.2 | |
| Qwen2.5-Coder-32BSetting=T=0.82025.11 | 41.5 | |
| RTLCoder-6.7BSetting=T=02025.11 | 35.9 | |
| RTLCoder-6.7BSetting=T-cross2025.11 | 33.7 | |
| RTLCoder-6.7BSetting=T=0.82025.11 | 31.5 | |
| Qwen2.5-Coder-7BSetting=T-cross2025.11 | 30.5 | |
| Qwen2.5-Coder-7BSetting=T=02025.11 | 30.1 | |
| Qwen2.5-Coder-7BSetting=T=0.82025.11 | 25.6 | |
| Deepseek-Coder-6.7BSetting=T=02025.11 | 24.4 | |
| Deepseek-Coder-6.7BSetting=T=0.82025.11 | 21 |