Kernel Generation on MACA kernel generation 45 operators (test)
100Activation CorrelationGPT-OSS-20B
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GPT-OSS-20BParameters=20B2026.03 | 100 | 1 | 3.25 | 100 | 88 | 29.7 | 94.1 | 53 | 3.63 | 100 | 80 | 8.56 | 97.8 | 78 | 8.69 | |
| Qwen3-30B-A3BParameters=30B2026.03 | 100 | 1 | 9.03 | 100 | 100 | 7.03 | 100 | 71 | 17.44 | 100 | 80 | 5.67 | 100 | 87 | 11.48 | |
| Qwen3-235B-2507-thinkParameters=235B2026.03 | 100 | 1 | 14.55 | 100 | 75 | 35.18 | 100 | 59 | 1.36 | 100 | 100 | 6.12 | 100 | 80 | 12.3 | |
| DeepSeek-v3.2-thinkVersion=v3.22026.03 | 100 | 1 | 10.09 | 100 | 88 | 6.06 | 94.1 | 47 | 8.6 | 100 | 60 | 2.89 | 97.8 | 73 | 8.01 | |
| Kimi-K2.5Version=K2.52026.03 | 100 | 1 | 12.62 | 100 | 100 | 29.37 | 100 | 65 | 5.11 | 100 | 60 | 2.21 | 100 | 82 | 11.6 | |
| Kernel-Smith-MACA-30BPlatform=MetaX MACA, Parameters=30B2026.03 | 100 | 1 | 13.61 | 100 | 88 | 36.03 | 100 | 71 | 4.69 | 100 | 40 | 5.02 | 100 | 80 | 13.27 | |
| Kernel-Smith-MACA-235BPlatform=MetaX MACA, Parameters=235B2026.03 | 100 | 1 | 9.25 | 100 | 88 | 40.59 | 100 | 65 | 9.63 | 100 | 100 | 3.07 | 100 | 84 | 14.26 |