RTL Design Code Generation on RTLLM v1.1
92Syntax AccuracyGPT-4o
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GPT-4oEvaluation Protocol=Original pass@12026.05 | 92 | 68 | |
| GPT-4oEvaluation Protocol=RTL-BenchMT fixes2026.05 | 92 | 70 | |
| Claude-3.7Evaluation Protocol=Original pass@12026.05 | 90 | 70 | |
| Claude-3.7Evaluation Protocol=RTL-BenchMT fixes2026.05 | 90 | 70 | |
| GPT-4o-miniEvaluation Protocol=Original pass@12026.05 | 88 | 56 | |
| GPT-3.5Evaluation Protocol=Original pass@12026.05 | 80 | 50 | |
| LlaMA-405BEvaluation Protocol=Original pass@12026.05 | 67.3 | 46.8 | |
| LlaMA-70BEvaluation Protocol=Original pass@12026.05 | 54 | 34 | |
| QwQ-32BEvaluation Protocol=Original pass@12026.05 | 28 | 26 |