Code Summarization on Code Summarization dataset benchmark leaderboard · SOTA2 Research

Code Summarization on Code Summarization dataset

78,246Input TokensBase

Evaluation Results

Method	Links
Base2025.05		78,246	—	7,668	—	85,914	—	10.59	—
DietCode2025.05		75,217	3.87	7,340	4.28	82,557	3.9	10.8	1.98
LeanCode2025.05		74,938	4.23	7,487	2.36	82,425	4.06	11.11	4.91
SlimCode2025.05		74,912	4.26	7,426	3.16	82,338	4.16	10.71	1.14
DietCode2025.05		72,245	7.67	7,583	1.11	79,828	7.08	10.21	3.59
SlimCode2025.05		70,734	9.96	7,715	0.61	78,449	8.69	10.89	2.83
LeanCode2025.05		70,207	10.28	8,278	7.95	78,485	8.66	10.69	1.09
DietCode2025.05		66,844	14.58	7,846	2.32	74,690	13.06	10.12	4.44
SlimCode2025.05		65,648	16.1	7,633	0.46	73,281	14.7	10.71	1.14
LeanCode2025.05		65,322	16.51	7,607	0.8	72,929	15.11	10.77	1.7
DietCode2025.05		61,534	21.36	8,015	4.52	69,549	19.06	9.95	6.04
SlimCode2025.05		60,585	22.57	7,773	1.37	68,358	20.43	10.62	0.28
LeanCode2025.05		60,296	22.93	8,163	6.45	68,459	20.32	10.9	2.93
DietCode2025.05		56,162	28.21	7,748	1.04	63,910	25.59	9.69	8.5
SlimCode2025.05		55,335	29.28	7,496	2.24	62,831	26.86	10.6	0.09
LeanCode2025.05		55,261	29.37	8,442	10.08	63,703	25.86	10.7	1.04