Code Summarization Factual Consistency on Python benchmark leaderboard · SOTA2 Research

Code Summarization Factual Consistency on Python

0.497Pearson Correlation (rp)ReFEree

Evaluation Results

Method	Links
ReFEree2026.04		0.497	0.489	0.39	0.459
ReFEree2026.04		0.432	0.432	0.349	0.404
G-Eval2026.04		0.427	0.413	0.36	0.4
LLM-judge2026.04		0.419	0.41	0.36	0.396
CODERPE2026.04		0.418	0.405	0.353	0.392
Factscore2026.04		0.41	0.426	0.338	0.391
SBCS2026.04		0.068	0.036	0.028	0.044
ROUGE-12026.04		0.046	0.044	0.034	0.041
ROUGE-L2026.04		0.045	0.037	0.029	0.037
METEOR2026.04		0.033	0.024	0.019	0.025
ROUGE-22026.04		0.03	0.031	0.024	0.028
BLEU2026.04		0.016	0.018	0.015	0.017
BERTScore2026.04		0.015	0	0	0.005
SBED2026.04		-0.058	-0.036	-0.028	-0.041
SIDE2026.04		-0.064	-0.056	-0.043	-0.054