Judge Performance on PERSUADE benchmark leaderboard · SOTA2 Research

Judge Performance on PERSUADE

0.955CCCGPT4o

Evaluation Results

Method	Links
GPT4o2026.03		0.955	0.96	0.944	0.226
Llama Maverick 42026.03		0.944	0.953	0.932	0.29
Llama Maverick 42026.03		0.942	0.948	0.837	0.4
Llama Maverick 42026.03		0.932	0.937	0.904	0.4
Gemini 2.5 Pro2026.03		0.927	0.935	0.916	0.344
Gemini 2.5 Pro2026.03		0.906	0.922	0.901	0.4
GPT4o2026.03		0.898	0.936	0.887	0.5
GPT4o2026.03		0.881	0.965	0.942	0.5
GPT4o2026.03		0.877	0.888	0.834	0.6
Claude Sonnet 4.52026.03		0.868	0.928	0.901	0.5
Gemini 2.5 Pro2026.03		0.853	0.886	0.85	0.4
Gemini 2.5 Pro2026.03		0.846	0.899	0.914	0.6
Claude Sonnet 4.52026.03		0.838	0.901	0.889	0.484
Llama Maverick 42026.03		0.823	0.905	0.891	0.6
Claude Sonnet 4.52026.03		0.819	0.915	0.914	0.6
GPT4o2026.03		0.744	0.963	0.973	0.6
GPT4o2026.03		0.741	0.856	0.829	0.7
Claude Sonnet 4.52026.03		0.739	0.943	0.958	0.9
Llama Maverick 42026.03		0.705	0.836	0.831	0.8
GPT4o2026.03		0.682	0.85	0.863	0.933
Gemini 2.5 Pro2026.03		0.682	0.834	0.864	1.1
Gemini 2.5 Pro2026.03		0.649	0.771	0.864	1.1
Llama Maverick 42026.03		0.634	0.709	0.733	1
Claude Sonnet 4.52026.03		0.627	0.834	0.911	1.3
Claude Sonnet 4.52026.03		0.6	0.901	0.846	1.3
Llama Maverick 42026.03		0.564	0.752	0.761	1.1
GPT4o2026.03		0.546	0.702	0.715	1.2
Gemini 2.5 Pro2026.03		0.465	0.6	0.659	1.3
Llama Maverick 42026.03		0.446	0.538	0.516	0.8
Claude Sonnet 4.52026.03		0.343	0.595	0.616	1.7
Gemini 2.5 Pro2026.03		0.21	0.427	0.468	1.2
Claude Sonnet 4.52026.03		0.125	0.327	0.444	1.2