Code Generation on HumanEval (pass@1)
62.2Pass@1SDAR-4B-Chat
Evaluation Results
| Method | Links | |
|---|---|---|
| SDAR-4B-ChatModel=SDAR-4B-Chat, Decoding Strategy=FourierSampler2026.01 | 62.2 | |
| SDAR-4B-ChatModel=SDAR-4B-Chat, Decoding Strategy=RWS2026.01 | 60.37 | |
| SDAR-4B-ChatModel=SDAR-4B-Chat, Decoding Strategy=Vanilla2026.01 | 57.93 | |
| SDAR-1.7B-ChatModel=SDAR-1.7B-Chat, Decoding Strategy=FourierSampler2026.01 | 43.29 | |
| SDAR-1.7B-ChatModel=SDAR-1.7B-Chat, Decoding Strategy=Vanilla2026.01 | 37.8 | |
| Qwen2.5-3B-InstructModel=Qwen2.5-3B-Instruct, Decoding Strategy=Vanilla2026.01 | 32.93 | |
| SDAR-1.7B-ChatModel=SDAR-1.7B-Chat, Decoding Strategy=RWS2026.01 | 31.71 | |
| Llama3.2-3B-InstructModel=Llama3.2-3B-Instruct, Decoding Strategy=Vanilla2026.01 | 26.83 |