Comprehension on GUI-EDA 1.0 (test) benchmark leaderboard · SOTA2 Research

Comprehension on GUI-EDA 1.0 (test)

77Acoustic (COMSOL, Ori.) ScoreQwen2.5VL-72B

Evaluation Results

Method	Links
Qwen2.5VL-72B2025.12		77	76	92	91	75	74	70	73	70	74	80	81	80	79	76.6
Qwen2VL-72B2025.12		71	71	71	74	71	71	71	75	91	89	80	80	80	80	75.5
Qwen2VL-7B2025.12		71	71	93	90	68	70	62	64	66	69	78	78	74	75	72.2
Ovis2-34B2025.12		69	69	96	94	61	66	69	73	60	67	76	80	74	76	72.4
InternVL2.5-78B2025.12		67	69	91	92	63	67	66	70	71	74	80	80	76	77	73.8
InternVL2.5-38B2025.12		65	68	84	85	61	63	61	64	64	66	74	74	69	71	68.4
UITARS-7B2025.12		64	64	80	78	56	59	59	60	52	58	68	72	60	61	62.9
InternVL2-40B2025.12		62	66	85	86	60	65	63	62	59	62	61	69	61	64	65.2
Gemini-API2025.12		61	62	81	81	59	63	57	59	50	56	70	75	69	68	64.2
Nvlm-70B2025.12		60	65	81	81	64	64	56	58	55	61	67	73	61	68	64.5
LLaVA-o-72B2025.12		59	65	92	87	69	67	57	60	62	65	70	74	69	72	68.1
Llama3-90B2025.12		59	59	81	84	61	64	59	60	54	58	67	69	62	64	63.2
OSAtlasPro-7B2025.12		57	53	72	64	68	62	46	48	54	54	56	58	62	60	57.4
GPT4o-API2025.12		55	62	81	80	57	60	60	61	60	65	61	71	62	67	63.4
OSAtlas-7B2025.12		53	56	67	66	61	63	52	53	56	56	68	69	59	63	58.7
CogAgent-9B2025.12		53	63	73	72	54	57	50	49	48	56	64	68	55	55	56.8
OSGenesis-AC-7B2025.12		51	59	73	75	57	63	52	55	50	58	69	73	61	65	60.8
Phi35-7B2025.12		50	55	83	84	52	52	59	59	48	50	58	60	57	58	57.8
LLaVANext-7B2025.12		50	53	73	69	50	55	55	55	38	41	54	58	54	56	53.1
Claude-API2025.12		45	59	73	77	47	60	53	58	30	50	47	64	54	62	55.1
MPlugOwl3-7B2025.12		45	48	84	73	55	52	51	45	40	41	53	51	54	53	51.8
Janus-7B2025.12		27	32	55	58	29	34	32	34	29	26	41	40	29	31	35