Kernel Generation on MACA kernel generation 45 operators (test) benchmark leaderboard · SOTA2 Research

Kernel Generation on MACA kernel generation 45 operators (test)

100Activation CorrelationGPT-OSS-20B

Evaluation Results

Method	Links
GPT-OSS-20B2026.03		100	1	3.25	100	88	29.7	94.1	53	3.63	100	80	8.56	97.8	78	8.69
Qwen3-30B-A3B2026.03		100	1	9.03	100	100	7.03	100	71	17.44	100	80	5.67	100	87	11.48
Qwen3-235B-2507-think2026.03		100	1	14.55	100	75	35.18	100	59	1.36	100	100	6.12	100	80	12.3
DeepSeek-v3.2-think2026.03		100	1	10.09	100	88	6.06	94.1	47	8.6	100	60	2.89	97.8	73	8.01
Kimi-K2.52026.03		100	1	12.62	100	100	29.37	100	65	5.11	100	60	2.21	100	82	11.6
Kernel-Smith-MACA-30B2026.03		100	1	13.61	100	88	36.03	100	71	4.69	100	40	5.02	100	80	13.27
Kernel-Smith-MACA-235B2026.03		100	1	9.25	100	88	40.59	100	65	9.63	100	100	3.07	100	84	14.26