Code Summarization
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
20.55Smoothed BLEU-4
38
Feb 26, 2026
20.83Java Score
38
Feb 26, 2026
78,246Input Tokens
16
Feb 26, 2026
57.1CompScore
14
Feb 26, 2026
64.2LLM PR
12
Jun 9, 2026
60.9LLM PR
12
Jun 9, 2026
84.76ASR
12
Feb 26, 2026
97.33ASR
12
Feb 26, 2026
81.36ASR
12
Feb 26, 2026
100Recall
12
Feb 26, 2026
100Recall
12
Feb 26, 2026
100Recall
12
Feb 26, 2026
13.21BLEU-4
12
Feb 26, 2026
22.95BLEU-4
11
Feb 26, 2026
21.01BLEU-4
11
Feb 26, 2026
0.253BLEU-1
9
Feb 26, 2026
20.63Overall Score
7
Feb 26, 2026
51.06Smoothed BLEU-4
6
Feb 26, 2026
0.737BERTScore
4
Jun 8, 2026
0.758BERTScore
4
Jun 8, 2026
21.99BLEU
4
Feb 26, 2026
2.49ASR
3
Jun 11, 2026
10.01ASR
3
Jun 11, 2026
11.91ASR
3
Jun 11, 2026
7ASR
3
Jun 11, 2026