Code Summarization on Verilog
64.2LLM PRROSUM-MCTS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ROSUM-MCTSLLM=GPT-4o2026.06 | 64.2 | 55.4 | |
| ROSUM-MCTSLLM=Llama-32026.06 | 55.6 | 48.8 | |
| CODESLLM=GPT-4o2026.06 | 55 | 46.9 | |
| VanillaLLM=GPT-4o2026.06 | 52.4 | 43.1 | |
| ROSUM-MCTSLLM=Granite Code-34b2026.06 | 50.3 | 44.2 | |
| CODESLLM=Llama-32026.06 | 48.7 | 43.5 | |
| VanillaLLM=Llama-32026.06 | 45.9 | 40.2 | |
| CODESLLM=Granite Code-34b2026.06 | 43.8 | 37.8 | |
| VanillaLLM=Granite Code-34b2026.06 | 40.5 | 33 | |
| ROSUM-MCTSLLM=DeepSeek-Coder-33b2026.06 | 40.5 | 36.7 | |
| CODESLLM=DeepSeek-Coder-33b2026.06 | 35.5 | 31.2 | |
| VanillaLLM=DeepSeek-Coder-33b2026.06 | 32.1 | 29.5 |