Dot Product on CUDA-LLM task suite
3.99Execution Time (ms)OptiML
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| OptiMLOptimization=OptiML (G+X)2026.02 | 3.99 | 1.73 | 19.06 | 23.21 | 19.43 | 198 | 613 | 462 | 58.22 | 28 | |
| HPC-Coder-V2 + OptiML-XOptimization=OptiML-X2026.02 | 4.22 | 1.64 | 18.74 | 23.81 | 19.02 | 205 | 627 | 471 | 56.88 | 28 | |
| GPT 5.1 + OptiML-XOptimization=OptiML-X2026.02 | 4.37 | 1.58 | 18.31 | 24.44 | 18.73 | 211 | 643 | 480 | 56.13 | 28 | |
| StarCoder2 + OptiML-XOptimization=OptiML-X2026.02 | 4.56 | 1.51 | 17.62 | 24.63 | 18.31 | 214 | 646 | 488 | 55.44 | 28 | |
| Qwen2.5-Coder + OptiML-XOptimization=OptiML-X2026.02 | 4.73 | 1.46 | 17.11 | 25.02 | 18.02 | 219 | 658 | 494 | 54.91 | 28 | |
| GPT 5.1Optimization=None (LLM-only baseline)2026.02 | 6.9 | — | 14.27 | 29.18 | 16.44 | 262 | 776 | 516 | 50.33 | 26 | |
| Qwen2.5-CoderOptimization=None (LLM-only baseline)2026.02 | 7.15 | 0.97 | 13.88 | 29.84 | 16.01 | 274 | 812 | 538 | 49.71 | 28 | |
| HPC-Coder-V2Optimization=None (LLM-only baseline)2026.02 | 7.36 | 0.94 | 13.55 | 30.21 | 15.73 | 282 | 836 | 553 | 49.23 | 28 | |
| StarCoder2Optimization=None (LLM-only baseline)2026.02 | 7.58 | 0.91 | 13.24 | 30.55 | 15.48 | 291 | 861 | 568 | 48.79 | 30 |