List your company

Summarization on CNN/DM (m, FC)

7.49ROUGE (m)Top-k
4.22445.07225.926.7678Sep 26, 2025

Evaluation results

MethodLinks
Top-kBackbone=Llama-3.1-8B/Llama-3.2-1B, k=22025.097.4962.5
SelfJudge-FBackbone=Llama-3.1-8B/Llama-3.2-1B, Thresholding strategy=best F1 score2025.096.0563.9
SelfJudge-RBackbone=Llama-3.1-8B/Llama-3.2-1B, Thresholding strategy=best recall2025.094.9265.5
AutoJudge-FBackbone=Llama-3.1-8B/Llama-3.2-1B, Thresholding strategy=best F1 score2025.094.7464.5
AutoJudge-RBackbone=Llama-3.1-8B/Llama-3.2-1B, Thresholding strategy=best recall2025.094.3664.5
SDBackbone=Llama-3.1-8B/Llama-3.2-1B2025.094.3564.6