GPU Programming Performance on KernelBench level 1 (test)
69Compilation Successdevstral-2512
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| devstral-2512Method=+IB (Inductive Bias)2026.06 | 69 | 57 | 14 | 5 | 2 | |
| gpt-oss-120bMethod=+IB (Inductive Bias)2026.06 | 63 | 56 | 33 | 11 | 5 | |
| deepseek-v3.1Method=+IB (Inductive Bias)2026.06 | 57 | 55 | 20 | 9 | 3 | |
| Qwen3-30B-A3BMethod=+IB (Inductive Bias)2026.06 | 53 | 48 | 12 | 3 | 2 | |
| gpt-oss-120bMethod=IR (Iterative Refinement)2026.06 | 53 | 48 | 21 | 4 | 2 | |
| Qwen3-32BMethod=+IB (Inductive Bias)2026.06 | 41 | 39 | 11 | 2 | 1 | |
| Qwen3-30B-A3BMethod=IR (Iterative Refinement)2026.06 | 40 | 38 | 2 | 0 | 0 | |
| devstral-2512Method=IR (Iterative Refinement)2026.06 | 38 | 33 | 9 | 5 | 2 | |
| Qwen3-14BMethod=+IB (Inductive Bias)2026.06 | 34 | 29 | 11 | 3 | 2 | |
| deepseek-v3.1Method=IR (Iterative Refinement)2026.06 | 28 | 26 | 9 | 5 | 2 | |
| Qwen3-32BMethod=IR (Iterative Refinement)2026.06 | 26 | 23 | 6 | 0 | 0 | |
| Qwen3-14BMethod=IR (Iterative Refinement)2026.06 | 22 | 19 | 4 | 1 | 1 |