Verilog Code Generation on RTLLM v2.0
84.09Pass@5ChipSeek-QC
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ChipSeek-QCBackbone=Qwen2.5 Coder2025.07 | 84.09 | 0.96 | 0.88 | 0.81 | |
| ChipSeek-CLBackbone=CodeLlama2025.07 | 77.27 | 0.85 | 0.76 | 0.74 | |
| ChipSeek-DC-7BBackbone=DeepSeek-Coder-7B2025.07 | 75 | 0.93 | 0.84 | 0.78 | |
| GPT-o12025.07 | 72.73 | 1.14 | 1.06 | 0.99 | |
| ChipSeek-CQBackbone=Code Qwen2025.07 | 72.73 | 0.84 | 0.83 | 0.81 | |
| GPT-4o2025.07 | 70.45 | 1.13 | 1.02 | 0.84 | |
| Origen-DC-7BBackbone=DeepSeek-Coder-7B2025.07 | 65.91 | 3.17 | 1.45 | 0.85 | |
| CodeV-DC-6.7BBackbone=DeepSeek-Coder-6.7B2025.07 | 63.64 | 2.3 | 1.56 | 1.28 | |
| CodeV-CQBackbone=Code Qwen2025.07 | 61.36 | 3.35 | 2.53 | 1.03 | |
| CodeV-CLBackbone=CodeLlama2025.07 | 59.09 | 2.12 | 1.43 | 1.02 | |
| DeepSeek-Coder-7B2025.07 | 56.82 | 3 | 2.65 | 1.91 | |
| Qwen2.5-Coder2025.07 | 56.82 | 1.38 | 1.04 | 0.89 | |
| RTLCoder-DC-6.7BBackbone=DeepSeek-Coder-6.7B2025.07 | 52.27 | 5.83 | 3.73 | 1.41 | |
| RTLCoder-MBackbone=Mistral2025.07 | 50 | 2.97 | 2.43 | 0.83 | |
| Verigen-MCTS2025.07 | 45.45 | 0.96 | 0.93 | 0.87 | |
| CodeLlama2025.07 | 43.18 | 1.04 | 0.94 | 0.87 | |
| CodeQwen2025.07 | 38.64 | 2.76 | 2.56 | 2.41 |