CUDA Code Generation on CUDABench Level 1 (test)
96.8Pass@1 (Compilation)KernelCoder
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| KernelCoderType=Reasoning, #Params=32B2026.06 | 96.8 | 70.6 | 99.6 | 79.8 | 5,379 | |
| KevinType=Reasoning, #Params=32B2026.06 | 96 | 68.8 | 99.6 | 78.2 | 5,392 | |
| Qwen2.5-Coder-32B-InstructType=Code, #Params=32B, Fine-tuned with=CuSeT2026.06 | 96 | 75.6 | 98.8 | 81 | 726 | |
| DeepSeek-Coder-6.7B-InstructType=Code, #Params=6.7B, Fine-tuned with=CuSeT2026.06 | 95 | 63.2 | 99 | 70.6 | 1,018 | |
| Seed-Coder-8B-InstructType=Code, #Params=8B, Fine-tuned with=CuSeT2026.06 | 94.6 | 67.8 | 98.8 | 75.8 | 839 | |
| DeepSeek-V3.2-ThinkingType=Reasoning, #Params=685B2026.06 | 93.8 | 66.6 | 99.4 | 80.6 | 3,717 | |
| Qwen2.5-Coder-7B-InstructType=Code, #Params=7B, Fine-tuned with=CuSeT2026.06 | 93.6 | 65.6 | 98.8 | 74.8 | 743 | |
| Qwen3-14BType=General, #Params=14B, Fine-tuned with=CuSeT2026.06 | 92.6 | 66.8 | 97.6 | 76 | 722 | |
| Qwen3-Coder-NextType=Code, #Params=80B2026.06 | 86 | 63.4 | 98 | 80.8 | 1,273 | |
| GLM-5.1Type=Reasoning, #Params=40B/744B2026.06 | 16.8 | 15.6 | 32.2 | 29.2 | 8,220 |