Visualization Assessment on VISJUDGE-BENCH benchmark leaderboard · SOTA2 Research

Visualization Assessment on VISJUDGE-BENCH

0.421Overall MAEVISJUDGE

Evaluation Results

Method	Links
VISJUDGE2025.10		0.421	0.661	0.648	0.677	0.58	0.545	0.604	0.286	0.747	0.69	0.756	0.545	0.498	0.578	0.687	0.574	0.628	0.576	0.568	0.513	0.385
VISJUDGE2025.10		0.491	0.705	0.721	0.696	0.625	0.571	0.616	0.377	0.855	0.85	0.822	0.62	0.539	0.603	0.648	0.533	0.581	0.579	0.504	0.49	0.402
VISJUDGE2025.10		0.496	0.767	0.695	0.775	0.643	0.574	0.598	0.383	0.919	0.752	0.952	0.642	0.541	0.619	0.605	0.226	0.536	0.443	0.432	0.406	0.403
VISJUDGE2025.10		0.541	0.797	0.769	0.691	0.608	0.645	0.616	0.437	1.068	0.951	0.822	0.638	0.736	0.655	0.66	0.533	0.594	0.545	0.499	0.391	0.42
GPT-4-Turbo2025.10		0.553	0.862	0.781	0.778	0.649	0.699	0.682	0.486	1.219	0.989	0.97	0.72	0.862	0.81	0.428	0.255	0.439	0.382	0.463	0.276	0.295
GPT-4o2025.10		0.61	0.988	0.806	0.744	0.609	0.695	0.657	0.577	1.562	1.063	0.921	0.627	0.823	0.729	0.482	0.381	0.539	0.442	0.471	0.277	0.363
Claude-3-Sonnet2025.10		0.622	0.841	0.757	0.832	0.679	0.734	0.785	0.603	1.182	0.973	1.147	0.774	0.934	1.037	0.465	0.393	0.55	0.452	0.421	0.163	0.228
Gemini-1.5-Pro2025.10		0.662	1.243	0.945	0.9	0.84	0.918	0.98	0.677	2.291	1.478	1.371	1.112	1.325	1.46	0.265	0.178	0.379	0.353	0.445	0.193	0.208
Gemini-1.5-Flash2025.10		0.682	0.829	0.912	0.82	0.638	0.729	0.798	0.72	1.182	1.326	1.12	0.673	0.925	1.057	0.395	0.372	0.459	0.417	0.459	0.157	0.209
Qwen2.5-VL-72B-Instruct2025.10		0.702	0.999	0.926	0.811	0.663	0.735	0.717	0.762	1.626	1.373	1.092	0.713	0.932	0.87	0.44	0.331	0.479	0.416	0.435	0.165	0.251
Qwen2.5-VL-32B-Instruct2025.10		0.703	0.909	0.987	0.801	0.678	0.761	0.719	0.756	1.361	1.528	1.067	0.728	0.988	0.88	0.435	0.348	0.468	0.408	0.449	0.2	0.268
Llava-v1.6-mistral-7B2025.10		0.724	0.929	1.124	0.939	0.801	0.814	0.818	0.817	1.513	1.96	1.403	1.007	1.071	1.076	0.18	0.201	0.137	0.16	0.188	0.064	0.076
InternVL2-8B2025.10		0.793	1.234	1.193	0.87	0.679	0.759	0.753	0.934	2.24	2.088	1.219	0.747	0.981	0.968	0.409	0.323	0.407	0.344	0.419	0.216	0.17
Qwen2.5-VL-3B-Instruct2025.10		0.821	1.085	1.258	1.088	0.723	0.727	0.808	1.028	1.872	2.4	1.852	0.868	0.903	1.046	0.272	0.199	0.222	0.275	0.338	0.13	0.155
Claude-3.5-Sonnet2025.10		0.824	0.978	0.904	1.154	0.783	0.94	0.862	1.009	1.577	1.306	1.989	0.994	1.467	1.198	0.395	0.325	0.492	0.365	0.455	0.137	0.259
Qwen2.5-VL-7B-Instruct2025.10		0.847	1.171	1.296	0.858	0.756	0.812	0.772	1.045	2.051	2.413	1.177	0.938	1.093	0.996	0.341	0.341	0.352	0.281	0.357	0.149	0.155