RTL Design Code Generation on CVDP cid02
22.4Function AccuracyClaude-3.7
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Claude-3.7Evaluation Protocol=RTL-BenchMT fixes2026.05 | 22.4 | — | |
| Claude-3.7Evaluation Protocol=Original pass@12026.05 | 21.3 | — | |
| GPT-4oEvaluation Protocol=RTL-BenchMT fixes2026.05 | 20.2 | — | |
| GPT-4oEvaluation Protocol=Original pass@12026.05 | 19.1 | — | |
| LlaMA-405BEvaluation Protocol=Original pass@12026.05 | 16 | — | |
| GPT-4o-miniEvaluation Protocol=Original pass@12026.05 | 10.6 | — | |
| LlaMA-70BEvaluation Protocol=Original pass@12026.05 | 10.6 | — | |
| QwQ-32BEvaluation Protocol=Original pass@12026.05 | 8.5 | — |