Verilog Generation on RTLLM v2 (test)
68Pass@1CodeV-R1-7B
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| CodeV-R1-7BOpen source=true2025.05 | 68 | 78.2 | 81.7 | |
| DeepSeek-R1-671BOpen source=true2025.05 | 64.7 | 75.8 | 79.7 | |
| DeepSeek-V3-671BOpen source=true2025.05 | 59.1 | 71.5 | 73.3 | |
| CodeV-R1-7B-DistillOpen source=true2025.05 | 57.2 | 71.9 | 77.1 | |
| GPT-4oOpen source=false2025.05 | 56.5 | 70.3 | 75.2 | |
| QWQ-32BOpen source=true2025.05 | 52.9 | 68 | 71.2 | |
| Qwen2.5-Coder-32B-InstructOpen source=true2025.05 | 47.8 | 63.9 | 67.8 | |
| DeepSeek-R1-Distill-Qwen-32BOpen source=true2025.05 | 42.4 | 62.1 | 67 | |
| Qwen2.5-Coder-7B-InstructOpen source=true2025.05 | 36.1 | 52.4 | 57.6 | |
| RTLCoder-DS-6.7BOpen source=true2025.05 | 33.6 | 45.3 | 49.2 | |
| DeepSeek-R1-Distill-Qwen-7BOpen source=true2025.05 | 0 | 0 | 0 |