Kernel Generation on KernelBench Level 2
16CR (Round 1)Codex
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| CodexModel=GPT-5.22026.03 | 16 | 84 | 0 | 22 | |
| RefinementModel=DeepSeek-V3.22026.03 | 2 | 26 | 0 | 0 | |
| Pass@kModel=GPT-5.22026.03 | 2 | 13 | 1 | 3 | |
| RefinementModel=GPT-5.22026.03 | 2 | 55 | 1 | 3 | |
| EvoKernelModel=GPT-5.22026.03 | 2 | 100 | 1 | 76 | |
| EvoKernelModel=Qwen3-Coder-30B2026.03 | 1 | 3 | 0 | 0 | |
| Pass@kModel=DeepSeek-V3.22026.03 | 1 | 13 | 0 | 0 | |
| EvoKernelModel=DeepSeek-V3.22026.03 | 1 | 19 | 0 | 0 | |
| Pass@kModel=Qwen3-Coder-30B2026.03 | 0 | 2 | 0 | 0 | |
| RefinementModel=Qwen3-Coder-30B2026.03 | 0 | 1 | 0 | 0 |