KernelBench
Benchmarks
TaskDatasetSOTA resultTrendResults
KernelBench Level 3
24Executions Count
31
KernelBench Level 2
48Execution Count
31
KernelBench Level 1
46Exec Count
31
KernelBench 1.0 (test)
0.006Latency (us)
27
KernelBench task 001 (held-out)
62Hinted ASR
26
KernelBench Level 3 (test)
100Correctness Score
18
KernelBench Level 2 (test)
19Correctness
18
KernelBench Level 1 (test)
19Correctness
18
KernelBench Level 3
32.2Fast1
17
KernelBench Level 1
37.2Fast1 Score
17
KernelBench Level 2
70.6Fast1 Score
17
KernelBench LEVEL3 1.0
29.8Fast1 Score
17
KernelBench LEVEL2 1.0
80.9Fast1 Score
17
KernelBench LEVEL1 1.0
39.3Fast1
17
KernelBench Level-3
100Accuracy
14
KernelBench Level-2
100Accuracy
14
KernelBench FP4 Matmul
2,898Throughput (TF/s)
14
KernelBench
3.45Speedup
14
KernelBench level 1 (test)
69Compilation Success
12
KernelBench Level 2
100Accuracy
11
KernelBench Level 1
99Correctness
11
KernelBench v0.2.0.dev0 (full 250-task suite)
98.4Correctness Rate
11
KernelBench Overall
25CR (Round 1)
10
KernelBench Level 2
16CR (Round 1)
10
KernelBench Level 1
34Correctness Rate (Round 1)
10