KernelBench
Benchmarks
TaskDatasetSOTA resultTrendResults
KernelBench AVG Level-1 2 3
99.33Correlation Coefficient
8
KernelBench Level 3 (Hard)
98Correctness (Corr)
8
KernelBench Level 2 (Medium)
100Correlation Coefficient
8
KernelBench Level 1 (Easy)
100Accuracy
8
KernelBench Level 3
87Fast1
7
KernelBench Level 1
2.42Geometric Mean
7
KernelBench Level 3 (complete networks)
100Success Rate
6
KernelBench Level 2 fused operators
100Success Rate
6
KernelBench Level 1 basic operators
100Success Rate
6
KernelBench Level 3
76Accuracy
6
KernelBench Level 2
96Accuracy
6
KernelBench Level 1
69Accuracy
6
KernelBench Level 3
5.3Average Speedup
6
KernelBench Level 5 v1
2.35RWKVTorch
5
KernelBench LLM-augmented shapes
0.033S1 Time (ms)
5
KernelBench fusion Level 2
88Fast1 (Natural)
5
KernelBench Level 1 (single-op)
89fast1 Performance (Native)
5
KernelBench Level 1
8Success Rate (p=1.0)
5
KernelBench (val)
1.089MLP Speedup
3
KernelBench H200 hardware
81Correctness best@16
3
KernelBench Level 2 (100 fused/composed operators)
4.69Geometric Mean Speedup
2
KernelBench 62_Matmul_GN_LReLU_Sum (Level 2)
1.83Execution Time (ms)
2
KernelBench 88_Gemm_GN_Swish_Mul_Swish (Level 2)
1.65Execution Time (ms)
2
KernelBench 22_Matmul_Scale_LSE_Mish (Level 2)
1.51Execution Time (ms)
2
KernelBench (test)
1.01ReLU Performance
1