# Triton kernel generation on KernelBench LEVEL1 1.0

Source: [Triton kernel generation on KernelBench LEVEL1 1.0](<https://www.sota2.com/research/sota/triton-kernel-generation-on-kernelbench-level1-1-0>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:45:12.129Z

Evaluation of Triton kernel generation performance on KernelBench LEVEL1 version 1.0, measured by specific fast performance indicators (Fast1, Fast1.2, Fast1.5, Fast2).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Triton kernel generation |
| Dataset (including any stated split) | KernelBench LEVEL1 1.0 |
| Metric | Fast1 |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 17 of 17 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Fast1](<https://www.sota2.com/research/sota/triton-kernel-generation-on-kernelbench-level1-1-0.md?metric=Fast1>): Higher is better; unit: SCALAR.

- [Fast1.2](<https://www.sota2.com/research/sota/triton-kernel-generation-on-kernelbench-level1-1-0.md?metric=Fast1.2>): Higher is better; unit: SCALAR.

- [Fast1.5](<https://www.sota2.com/research/sota/triton-kernel-generation-on-kernelbench-level1-1-0.md?metric=Fast1.5>): Higher is better; unit: SCALAR.

- [Fast2](<https://www.sota2.com/research/sota/triton-kernel-generation-on-kernelbench-level1-1-0.md?metric=Fast2>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Fast1 | Result date | Report paper |
| --- | --- | --- | --- |
| DR. KERNEL-14B-STTS | 39.3 | Not recorded | 698575d8c97a0b3e3b5d5e92 |
| DR. KERNEL-14B-STTS | 24.1 | Not recorded | 698575d8c97a0b3e3b5d5e92 |
| DR. KERNEL-14B | 20.3 | Not recorded | 698575d8c97a0b3e3b5d5e92 |
| GPT-5 | 19.5 | Not recorded | 698575d8c97a0b3e3b5d5e92 |
| GLM-4.7 | 19.4 | Not recorded | 698575d8c97a0b3e3b5d5e92 |
| GPT-5 | 18.6 | Not recorded | 698575d8c97a0b3e3b5d5e92 |
| DR. KERNEL-14B | 17.8 | Not recorded | 698575d8c97a0b3e3b5d5e92 |
| DR. KERNEL-8B | 16 | Not recorded | 698575d8c97a0b3e3b5d5e92 |
| DR. KERNEL-8B | 15.9 | Not recorded | 698575d8c97a0b3e3b5d5e92 |
| Claude-4.5-Sonnet | 15.5 | Not recorded | 698575d8c97a0b3e3b5d5e92 |
| Claude-4.5-Sonnet | 10 | Not recorded | 698575d8c97a0b3e3b5d5e92 |
| Deepseek-V3.2-Thinking | 7.5 | Not recorded | 698575d8c97a0b3e3b5d5e92 |
| Cold-Start-8B | 7.5 | Not recorded | 698575d8c97a0b3e3b5d5e92 |
| Qwen3-32B | 6.1 | Not recorded | 698575d8c97a0b3e3b5d5e92 |
| Qwen3-Coder-A30BA3 | 6 | Not recorded | 698575d8c97a0b3e3b5d5e92 |
| Qwen3-8B | 5.8 | Not recorded | 698575d8c97a0b3e3b5d5e92 |
| AutoTriton | 4.5 | Not recorded | 698575d8c97a0b3e3b5d5e92 |

### DR. KERNEL-14B-STTS

Fast1: 39.3. Result ID: 6998ee085698665ec4529c8f.

[Reporting paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

[Method origin paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

Recorded evaluation configuration: {"scaling\_method":"sequential test-time scaling (STTS)","selection\_strategy":"best turn selection"}. This record does not assert independent reproduction.

### DR. KERNEL-14B-STTS

Fast1: 24.1. Result ID: 6998ee085698665ec4529c8e.

[Reporting paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

[Method origin paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

Recorded evaluation configuration: {"scaling\_method":"sequential test-time scaling (STTS)"}. This record does not assert independent reproduction.

### DR. KERNEL-14B

Fast1: 20.3. Result ID: 6998ee085698665ec4529c8d.

[Reporting paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

[Method origin paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GPT-5

Fast1: 19.5. Result ID: 6998ee085698665ec4529c83.

[Reporting paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GLM-4.7

Fast1: 19.4. Result ID: 6998ee085698665ec4529c86.

[Reporting paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GPT-5

Fast1: 18.6. Result ID: 6998ee085698665ec4529c77.

[Reporting paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

Recorded evaluation configuration: {"Evaluation Engine":"torch.compile"}. This record does not assert independent reproduction.

### DR. KERNEL-14B

Fast1: 17.8. Result ID: 6998ee085698665ec4529c7a.

[Reporting paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

[Method origin paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

Recorded evaluation configuration: {"Evaluation Engine":"torch.compile"}. This record does not assert independent reproduction.

### DR. KERNEL-8B

Fast1: 16. Result ID: 6998ee085698665ec4529c79.

[Reporting paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

[Method origin paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

Recorded evaluation configuration: {"Evaluation Engine":"torch.compile"}. This record does not assert independent reproduction.

### DR. KERNEL-8B

Fast1: 15.9. Result ID: 6998ee085698665ec4529c8c.

[Reporting paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

[Method origin paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Claude-4.5-Sonnet

Fast1: 15.5. Result ID: 6998ee085698665ec4529c84.

[Reporting paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Claude-4.5-Sonnet

Fast1: 10. Result ID: 6998ee085698665ec4529c78.

[Reporting paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

Recorded evaluation configuration: {"Evaluation Engine":"torch.compile"}. This record does not assert independent reproduction.

### Deepseek-V3.2-Thinking

Fast1: 7.5. Result ID: 6998ee085698665ec4529c85.

[Reporting paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Cold-Start-8B

Fast1: 7.5. Result ID: 6998ee085698665ec4529c8b.

[Reporting paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"training":"cold-start data"}. This record does not assert independent reproduction.

### Qwen3-32B

Fast1: 6.1. Result ID: 6998ee085698665ec4529c88.

[Reporting paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Qwen3-Coder-A30BA3

Fast1: 6. Result ID: 6998ee085698665ec4529c89.

[Reporting paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Qwen3-8B

Fast1: 5.8. Result ID: 6998ee085698665ec4529c87.

[Reporting paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### AutoTriton

Fast1: 4.5. Result ID: 6998ee085698665ec4529c8a.

[Reporting paper](<https://www.sota2.com/research/paper/698575d8c97a0b3e3b5d5e92.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79f21e209131cea802d1.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
