ReLU Activation Function on CUDA-LLM task suite benchmark leaderboard · SOTA2 Research

ReLU Activation Function on CUDA-LLM task suite

4.49TimeOptiML

Evaluation Results

Method	Links
OptiML2026.02		4.49	1.67	16.72	32.03	19.37	201	689	322	49.66	22
HPC-Coder-V2 + OptiML-X2026.02		4.68	1.6	15.98	33.61	18.92	206	701	327	48.88	22
GPT 5.1 + OptiML-X2026.02		4.87	1.54	15.64	34.28	18.71	212	717	332	48.17	22
StarCoder2 + OptiML-X2026.02		4.99	1.5	15.12	34.72	18.44	214	726	335	47.84	22
Qwen2.5-Coder + OptiML-X2026.02		5.24	1.43	14.92	35.14	18.21	220	751	342	47.06	22
GPT 5.12026.02		7.5	—	12.11	41.37	16.44	263	883	358	42.19	20
Qwen2.5-Coder2026.02		7.8	0.96	11.74	42.12	16.06	274	918	372	41.61	22
HPC-Coder-V22026.02		8.02	0.93	11.48	42.43	15.89	281	939	381	41.18	22
StarCoder22026.02		8.31	0.9	11.21	42.77	15.73	289	962	392	40.77	22