Mechanical Drawing Understanding on MechVQA (test) benchmark leaderboard · SOTA2 Research

Mechanical Drawing Understanding on MechVQA (test)

88.37IC ScoreGLM-4.6V

Evaluation Results

Method	Links
GLM-4.6V2026.05		88.37	86.68	97.73	63.31	77.08	82.93	60	62	74.29	69.33	78.91
MechVL-4B-SFT2026.05		88.37	85.2	97.73	61.15	60.42	73.17	40	44	84.49	69.33	76.36
MechVL-4B-RL2026.05		88.37	90.7	97.73	82.01	83.33	76.83	84	64	86.94	78.67	84.85
Qwen3-VL-32B-Instruct2026.05		86.05	86.68	97.73	56.83	62.5	76.83	62	48	75.92	69.33	76.5
Qwen3-VL-Plus2026.05		81.4	86.68	95.45	52.88	81.25	79.67	74	58	67.76	68	76.33
MiniCPM-V-4.52026.05		79.07	76.32	84.09	30.22	45.83	59.76	24	36	60	46.67	60.51
Mimo-VL-7B-SFT2026.05		79.07	76.74	93.18	38.85	27.08	54.47	26	20	59.59	46.67	59.66
Gemini-3-Pro-Preview2026.05		76.74	87.74	97.73	64.03	52.08	73.58	46	58	78.37	82.67	77.28
Qwen3-VL-30B-A3B-Instruct2026.05		74.42	78.01	90.91	37.41	43.75	64.23	38	40	64.08	57.33	64.47
GPT-52026.05		69.77	84.99	93.18	62.59	79.17	73.58	60	60	71.02	70.67	75.44
Claude-Sonnet-4.52026.05		67.44	78.65	97.73	56.12	70.83	75.2	62	54	64.9	64	71.2
InternVL3.5-8B2026.05		65.12	61.1	77.27	19.42	37.5	48.78	28	34	53.47	34.67	49.82
Qwen3-VL-4B-Instruct2026.05		62.79	76.96	88.64	33.09	39.58	58.54	22	20	62.86	49.33	60.23
GPT-4o2026.05		62.79	75.9	81.82	40.29	64.58	63.41	48	44	53.06	66.67	63.06
Gemma-3-27B-it2026.05		46.51	55.39	70.45	24.46	31.25	51.22	24	24	24.9	40	42.68
GPT-4o-mini2026.05		32.56	61.52	68.18	23.02	29.17	47.97	24	22	35.1	49.33	45.65
Llama-3.2-11B-Vision-Instruct2026.05		13.95	38.05	54.55	11.51	6.25	25.61	0	8	17.55	28	25.48