Matrix Copy on CUDA-LLM task suite
5.12Execution TimeOptiML
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| OptiMLOptimization=OptiML (G+X)2026.02 | 5.12 | 1.64 | 9.66 | 85.12 | 12.66 | 793 | 1,312 | 160 | 41.07 | 16 | |
| HPC-Coder-V2 + OptiML-XOptimization=OptiML-X2026.02 | 5.38 | 1.56 | 9.28 | 86.72 | 12.34 | 808 | 1,344 | 163 | 40.71 | 16 | |
| GPT 5.1 + OptiML-XOptimization=OptiML-X2026.02 | 5.6 | 1.5 | 8.97 | 87.41 | 12.13 | 824 | 1,377 | 166 | 40.12 | 16 | |
| StarCoder2 + OptiML-XOptimization=OptiML-X2026.02 | 5.82 | 1.44 | 8.52 | 87.96 | 11.92 | 835 | 1,393 | 169 | 39.66 | 16 | |
| Qwen2.5-Coder + OptiML-XOptimization=OptiML-X2026.02 | 6.09 | 1.38 | 8.74 | 88.26 | 11.62 | 848 | 1,418 | 171 | 39.27 | 16 | |
| GPT 5.1Optimization=None (LLM-only baseline)2026.02 | 8.4 | — | 7.21 | 91.86 | 10.29 | 975 | 1,644 | 178 | 34.29 | 16 | |
| Qwen2.5-CoderOptimization=None (LLM-only baseline)2026.02 | 8.75 | 0.96 | 6.94 | 92.48 | 9.96 | 1,012 | 1,712 | 186 | 33.78 | 18 | |
| HPC-Coder-V2Optimization=None (LLM-only baseline)2026.02 | 8.98 | 0.94 | 6.72 | 92.78 | 9.74 | 1,031 | 1,752 | 193 | 33.41 | 18 | |
| StarCoder2Optimization=None (LLM-only baseline)2026.02 | 9.21 | 0.91 | 6.53 | 93.05 | 9.58 | 1,052 | 1,796 | 199 | 33.07 | 18 |