Multimodal Dental Question Answering on MMOral-Uni

71.2II-LocOralAgent

Evaluation results

Method
OralAgent2026.04	71.2	55.65	58.22	50.06	67.23	59.27	78.67	65	57.7
OralGPT-Omni2026.04	66.8	56.6	39.99	48.11	65.9	56.01	47.33	65	51.84
o32026.04	45	53.49	28.19	37.48	28.6	37.52	75.33	50	38.7
GPT-52026.04	44.6	45.24	25.16	31.43	41.27	40.52	80.67	56	36.42
Gemini-2.5-flash2026.04	31	51.1	19.7	37.01	36.3	35.09	73.33	46	35.72
MedRAX2026.04	29.1	45.21	20.93	13.38	10.43	21.36	75.33	33	25.27
Doubao-1.5-vision-pro-32k2026.04	26.9	43.33	16.97	40.48	18.2	28.49	68	45	30.67
MiMo-VL-7B2026.04	25.4	36.28	22.51	34.62	18.7	31.91	62	43	29.62
GLM-4.5v2026.04	21.7	45.1	14.37	38.37	31	27.6	70	33	31.05
Qwen3-VL-235B-A22B2026.04	18.7	40	12.53	33.62	26.7	28.75	56	23	27.83
HealthGP2026.04	18	20.43	8.84	19.44	7.5	31.02	54.67	14	17.32
Mistral-Small-3.1-24B2026.04	16.3	28.14	18.77	29.15	11.5	27.02	62	28	23.69
GLM-4.1V-9B-Thinking2026.04	15.5	37.78	18.14	37.57	13.53	27.13	62	43	27.86
Ovis2.5-9B2026.04	15.4	37.47	19.76	36.7	18.13	34.33	66	61	29.6
Qwen3-VL-8B-Instruct2026.04	14.3	27.17	16.95	33.54	4.97	30.68	54	18	23.45
Lingshu-7B2026.04	12	30.58	25.77	27.48	20.5	30.94	48	20	27.08
HuatuoGPT-Vision-7B2026.04	11.9	30.19	23.1	25.79	19.57	28.02	41.33	19	25.41
MedGemma-27B2026.04	11.9	20.44	17.09	21.65	22.17	32.69	68.67	11	21.56
Grok-42026.04	11.8	35.71	20.27	30.89	22.6	34.73	72.67	23	28.47
Qwen2.5-VL-7B2026.04	11.2	25.4	23.84	19.72	13.7	30.73	36.67	12	22.88
InternVL3.5-8B2026.04	10.1	30.85	11.02	32.95	14.8	28.67	64.67	14	23.39
MedVLM-R12026.04	10.1	23.88	14.3	16.25	0	21.28	24	26	16.5
LLaVA-OneVision2026.04	7.5	23.13	17.59	14.34	0	11.49	40.67	5	15.39
Med-R1-Diagnosis2026.04	6.3	22.93	8.91	20.13	2	19.01	16	22	15.29
LLaVA-Med2026.04	5.4	3.99	5.81	25.31	1.5	16.08	28.67	14	10.16
LLaVA-v1.6-Mistral-7B2026.04	4.8	20.57	14.03	11.61	2.5	12.06	34.67	18	13.54
Chiron-o1-8B2026.04	4.6	20.94	17.37	34.95	2.03	31.2	42	23	21.61
R-4B2026.04	3.8	32.29	19.16	28.96	16.6	27.89	50.67	19	24.94
Phi-4-multimodal-instruct2026.04	3.7	18.32	7.86	18.31	1.67	9.63	34.67	7	12.12
MedAgents2026.04	2.5	41.61	22.59	39.11	0	38.33	0	19	29.52
MMedAgent2026.04	1.1	4.71	1.48	2.02	3.47	6.42	0.67	5	3.29
MDAgents2026.04	0	0	0	0	0	0	34	0	0.18