Code Completion on VerilogEval CC v2 (test)
79.1Pass@1DeepSeek-R1-671B
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| DeepSeek-R1-671BOpen source=true2025.05 | 79.1 | 85.1 | 87.1 | |
| CodeV-R1-7BOpen source=true2025.05 | 69.9 | 78.2 | 80.9 | |
| DeepSeek-V3-671BOpen source=true2025.05 | 68.7 | 76.3 | 78.2 | |
| CodeV-R1-7B-DistillOpen source=true2025.05 | 65.5 | 75.6 | 78.2 | |
| QWQ-32BOpen source=true2025.05 | 64 | 77.8 | 80.9 | |
| GPT-4oOpen source=false2025.05 | 57.6 | 66.1 | 69 | |
| DeepSeek-R1-Distill-Qwen-32BOpen source=true2025.05 | 53.8 | 69.8 | 73.8 | |
| Qwen2.5-Coder-32B-InstructOpen source=true2025.05 | 46.6 | 59 | 62.8 | |
| RTLCoder-DS-6.7BOpen source=true2025.05 | 33.7 | 45.9 | 49.8 | |
| Qwen2.5-Coder-7B-InstructOpen source=true2025.05 | 30.5 | 46.8 | 52 | |
| DeepSeek-R1-Distill-Qwen-7BOpen source=true2025.05 | 2 | 7 | 11.3 |