Verilog Syntax Generation on MFD Benchmark 8 (Pass@1)
100Pass@1DeepDeek-R1
Evaluation Results
| Method | Links | |
|---|---|---|
| DeepDeek-R1Prompting Protocol=RAG-based prompting methodology2026.02 | 100 | |
| Qwen2Prompting Protocol=RAG-based prompting methodology2026.02 | 80 | |
| Llama3Prompting Protocol=RAG-based prompting methodology2026.02 | 60 | |
| CodestralPrompting Protocol=RAG-based prompting methodology2026.02 | 20 | |
| CodeLlamaPrompting Protocol=RAG-based prompting methodology2026.02 | 0 |