Verilog Generation on RTLLM v2
90Pass@200GPT-OSS-120B-IGR
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GPT-OSS-120B-IGRSTG=false, Search Strategy=Idea-Guided Refinement2026.01 | 90 | 80 | 84 | 88 | 90 | |
| DeepSeek-R1-FP4-MCTSSTG=false, Search Strategy=Monte Carlo Tree Search2026.01 | 90 | 82 | 84 | 86 | 92 | |
| REvolution (Deepseek-V3)API Access=true2026.01 | 88 | — | — | — | — | |
| GPT-OSS-120B-MCTSSTG=false, Search Strategy=Monte Carlo Tree Search2026.01 | 88 | 78 | 84 | 86 | 88 | |
| DeepSeek-R1-FP42026.01 | 86 | 82 | 84 | 84 | 86 | |
| Siliconmind-7B2026.01 | 84 | 76 | 82 | 84 | 84 | |
| REvolution (Llama-3.3-70B)API Access=true2026.01 | 84 | — | — | — | — | |
| Siliconmind-7B-MCTSSTG=false, Search Strategy=Monte Carlo Tree Search2026.01 | 84 | 76 | 80 | 82 | 88 | |
| Gemini-2.0-Flash-MCTSSTG=false, Search Strategy=Monte Carlo Tree Search, API Access=true2026.01 | 82 | 68 | 78 | 80 | 82 | |
| Gemini-2.0-Flash-IGRSTG=false, Search Strategy=Idea-Guided Refinement, API Access=true2026.01 | 80 | 66 | 70 | 74 | 80 | |
| Gemini-2.0-FlashAPI Access=true2026.01 | 78 | 62 | 72 | 76 | 78 | |
| GPT-OSS-120B2026.01 | 76 | 76 | 76 | 76 | 76 |