Document Question Answering on DUDE (Accuracy Metrics) benchmark leaderboard · SOTA2 Research

Document Question Answering on DUDE (Accuracy Metrics)

80.7Accuracy (all)GPT-4o-200b-128

Evaluation Results

Method	Links
GPT-4o-200b-1282025.10		80.7	83	63.3
GPT-4o-200b-1282025.10		72.5	74.6	54.5
GPT-4o-200b-1282025.10		72	75	54.1
GPT-4o-200b-1282025.10		70.7	73.2	53.4
GPT-4o-200b-1282025.10		70.6	73.2	53.5
InternVL2-8B2025.10		64.1	69.7	57.4
InternVL2-8B2025.10		63	66.9	53.3
Pixtral-12B-24092025.10		60.2	63.6	46.7
Phi-3.5-Vision-4B2025.10		59.6	65.6	46.7
InternVL2-8B2025.10		58.9	60.9	41.6
Phi-3.5-Vision-4B2025.10		58.2	65.6	46.6
Phi-3.5-Vision-4B2025.10		57.8	63.8	44.6
InternVL2-8B2025.10		57.6	59.1	35
Phi-3.5-Vision-4B2025.10		57.6	64.3	45
Phi-3.5-Vision-4B2025.10		56.2	61.5	42.2
InternVL2-8B2025.10		56	56.4	36.7
Pixtral-12B-24092025.10		54.5	57.8	43.3
Pixtral-12B-24092025.10		53.5	57.4	42.6
Pixtral-12B-24092025.10		52.9	56	41.7
Pixtral-12B-24092025.10		51.4	51.2	41.7
MiniCPM-Llama3-V2.5-8B2025.10		19	21	15
Idefics2-8B2025.10		17	20.5	13
mPLUG-DocOwl 1.5-8B2025.10		15	18.8	11.6