RTL code generation on Rtllm (test)
42Pass@1DeepSeek-7B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DeepSeek-7BForget sets=20%2025.12 | 42 | 44 | |
| DeepSeek-7BForget sets=0%2025.12 | 40 | 44 | |
| DeepSeek-7BForget sets=10%2025.12 | 40 | 44 | |
| Qwen-7BForget sets=0%2025.12 | 40 | 48 | |
| Qwen-7BForget sets=10%2025.12 | 40 | 48 | |
| Qwen-7BForget sets=20%2025.12 | 40 | 46 | |
| Llama-8BForget sets=20%2025.12 | 38 | 42 | |
| DeepSeek-7BForget sets=30%2025.12 | 38 | 42 | |
| Llama-8BForget sets=0%2025.12 | 36 | 44 | |
| Qwen-7BForget sets=30%2025.12 | 36 | 44 | |
| Llama-7BForget sets=0%2025.12 | 34 | 40 | |
| Llama-8BForget sets=10%2025.12 | 34 | 44 | |
| Llama-7BForget sets=10%2025.12 | 32 | 40 | |
| Llama-7BForget sets=20%2025.12 | 32 | 40 | |
| Llama-7BForget sets=30%2025.12 | 30 | 38 | |
| Llama-8BForget sets=30%2025.12 | 30 | 36 |