Summarization Evaluation on SummEval (DW/theta_ratio Metrics) benchmark leaderboard · SOTA2 Research

Summarization Evaluation on SummEval (DW/theta_ratio Metrics)

1.55Relevance (theta_ratio)GPT-4o

Evaluation Results

Method	Links
GPT-4o2026.01		1.55	0.3	1.89	0.55	1.63	0.42	1.5	0.27
Qwen3-235b2026.01		1.47	0.21	1.36	0.42	1.76	0.5	1.55	0.32
GPT-4o-mini2026.01		1.39	0.34	2.2	0.57	2.29	0.57	1.66	0.31
Qwen3-30b2026.01		1.3	0.42	1.57	0.34	1.97	0.49	1.53	0.3
Llama-4-Scout2026.01		1.3	0.28	1.65	0.55	1.57	0.49	1.3	0.27
Llama-4-Maverick2026.01		1.07	0.25	1.29	0.41	1.33	0.47	0.98	0.24
Gemini 2.5 Flash2026.01		0.96	0.3	1.36	0.26	1.71	0.48	1.24	0.26