Document Visual Question Answering on DocVQA v1.0 (test)
96.5ANLSQwen2-VL-72B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Qwen2-VL-72B2024.12 | 96.5 | — | |
| InternVL2.5-38B2024.12 | 95.3 | — | |
| Claude-3.5-Sonnet2024.12 | 95.2 | — | |
| InternVL2.5-78B2024.12 | 95.1 | — | |
| Qwen2-VL-7B2024.12 | 94.5 | — | |
| InternVL2-Llama3-76B2024.12 | 94.1 | — | |
| InternVL2.5-26B2024.12 | 94 | — | |
| InternVL2-40B2024.12 | 93.9 | — | |
| Molmo-72B2024.12 | 93.5 | — | |
| Gemini-1.5-Pro2024.12 | 93.1 | — | |
| InternVL2.5-8B2024.12 | 93 | — | |
| InternVL2-26B2024.12 | 92.9 | — | |
| GPT-4o-202405132024.12 | 92.8 | — | |
| NVLM-D-72B2024.12 | 92.6 | — | |
| InternVL-1.5-Plusparameters=26B, pretraining corpora=26, fine-tuning corpora=492024.11 | 92.3 | — | |
| Molmo-7B-D2024.12 | 92.2 | — | |
| InternVL2.5-4B2024.12 | 91.6 | — | |
| InternVL2-8B2024.12 | 91.6 | — | |
| LLaVA-OneVision-72B2024.12 | 91.3 | — | |
| InternVL-Chat-V1.52024.12 | 90.9 | — | |
| MiniCPM-V2.62024.12 | 90.8 | — | |
| Qwen2-VL-2B2024.12 | 90.1 | — | |
| Claude-3-Opus2024.12 | 89.3 | — | |
| InternVL2-4B2024.12 | 89.2 | — | |
| InternVL2.5-2B2024.12 | 88.7 | — | |
| GPT-4V2024.12 | 88.4 | — | |
| InternVL2-2B2024.12 | 86.9 | — | |
| Aquila-VL-2B2024.12 | 85 | — | |
| InternVL2.5-1B2024.12 | 84.8 | — | |
| LayoutLMv3Model Category=Fine-tuned PTM, Evaluation Protocol=Fine-tuned, Implementation=Original Paper2024.04 | 83.37 | — | |
| InternVL2-1B2024.12 | 81.7 | — | |
| Cambrian-34B2024.12 | 75.5 | — | |
| LayoutLLM-7BModel Category=Ours, Evaluation Protocol=Zero-shot, Backbone Initialization=Vicuna-1.5-7B2024.04 | 74.27 | — | |
| LayoutLLM-7BModel Category=Ours, Evaluation Protocol=Zero-shot, Backbone Initialization=Llama2-7B-chat2024.04 | 74.25 | — | |
| HVFAbackbone=mPLUG-Owl, pretraining dataset=1B, fine-tuning dataset=650K, OCR-free=true2024.11 | 72.7 | — | |
| LLaVA-OneVision-0.5B2024.12 | 70 | — | |
| Phi-3.5-Vision-4B2024.12 | 69.3 | — | |
| Vicuna-1.5-7BModel Category=LLM, Input Representation=Plain Text, Evaluation Protocol=Zero-shot, Implementation=Re-implemented2024.04 | 66.99 | — | |
| Qwen-VL-7BModel Category=MLLM, Evaluation Protocol=Fine-tuned, Implementation=Original Paper2024.04 | 65.1 | — | |
| Llama2-7B-chatModel Category=LLM, Input Representation=Plain Text, Evaluation Protocol=Zero-shot, Implementation=Re-implemented2024.04 | 64.99 | — | |
| mPLUG-DocOWL-7BModel Category=MLLM, Evaluation Protocol=Fine-tuned, Implementation=Original Paper2024.04 | 62.2 | — | |
| Vicuna-7BModel Category=LLM, Input Representation=Plain Text, Evaluation Protocol=Zero-shot, Implementation=Re-implemented2024.04 | 61.39 | — | |
| Llama2-7BModel Category=LLM, Input Representation=Plain Text, Evaluation Protocol=Zero-shot, Implementation=Re-implemented2024.04 | 61.34 | — | |
| Vicuna-1.5-7BModel Category=LLM, Input Representation=Layout Text (Text + Box), Evaluation Protocol=Zero-shot, Implementation=Re-implemented2024.04 | 56.81 | — | |
| Llama2-7B-chatModel Category=LLM, Input Representation=Layout Text (Text + Box), Evaluation Protocol=Zero-shot, Implementation=Re-implemented2024.04 | 56.55 | — | |
| Llama2-7BModel Category=LLM, Input Representation=Layout Text (Text + Box), Evaluation Protocol=Zero-shot, Implementation=Re-implemented2024.04 | 37.32 | — | |
| Vicuna-7BModel Category=LLM, Input Representation=Layout Text (Text + Box), Evaluation Protocol=Zero-shot, Implementation=Re-implemented2024.04 | 37.21 | — | |
| LLaVA-1.5-7BModel Category=MLLM, Evaluation Protocol=Zero-shot, Implementation=Re-implemented2024.04 | 13.34 | — | |
| LLaVAR-7BModel Category=MLLM, Evaluation Protocol=Zero-shot, Implementation=Original Paper2024.04 | 11.6 | — | |
| AdaReasoner-7BTool Setting=w/ IID Tools2026.06 | — | 89.4 | |
| AdaReasoner-7BTool Setting=w/ OOD Tools2026.06 | — | 92.3 | |
| Claude-Sonnet-4-6Tool Setting=w/ IID Tools2026.06 | — | 98.18 | |
| Claude-Sonnet-4-6Tool Setting=w/ OOD Tools2026.06 | — | 98.08 | |
| DeepEyesV2-7BTool Setting=w/ IID Tools2026.06 | — | 89.9 | |
| DeepEyesV2-7BTool Setting=w/ OOD Tools2026.06 | — | 93.05 | |
| Gemini-3.1-Pro-PreviewTool Setting=w/ IID Tools2026.06 | — | 96.95 | |
| Gemini-3.1-Pro-PreviewTool Setting=w/ OOD Tools2026.06 | — | 96.13 | |
| GPT-5.4Tool Setting=w/ IID Tools2026.06 | — | 96.85 | |
| GPT-5.4Tool Setting=w/ OOD Tools2026.06 | — | 96.55 | |
| InternVL3.5-14BTool Setting=w/ IID Tools2026.06 | — | 87.6 | |
| InternVL3.5-14BTool Setting=w/ OOD Tools2026.06 | — | 88.2 | |
| InternVL3.5-38BTool Setting=w/ IID Tools2026.06 | — | 91.8 | |
| InternVL3.5-38BTool Setting=w/ OOD Tools2026.06 | — | 92.1 | |
| LLaVA-1.5 13BVIG training=false2026.02 | — | 24.08 | |
| LLaVA-1.5 13B + VIG trainingVIG training=true2026.02 | — | 25.27 | |
| LLaVA-1.5 7BVIG training=false2026.02 | — | 22.31 | |
| LLaVA-1.5 7B + VIG trainingVIG training=true2026.02 | — | 22.51 | |
| MetaForgeTool Setting=w/ IID Tools2026.06 | — | 97.9 | |
| MetaForgeTool Setting=w/ OOD Tools2026.06 | — | 97.22 | |
| PixelReasoner-RL-v1-7BTool Setting=w/ IID Tools2026.06 | — | 92.3 | |
| PixelReasoner-RL-v1-7BTool Setting=w/ OOD Tools2026.06 | — | 91.85 | |
| PyVision-Image-7B-RLTool Setting=w/ IID Tools2026.06 | — | 69.95 | |
| PyVision-Image-7B-RLTool Setting=w/ OOD Tools2026.06 | — | 77 | |
| Qwen2.5-VL-7BTool Setting=w/ IID Tools2026.06 | — | 93.43 | |
| Qwen2.5-VL-7BTool Setting=w/ OOD Tools2026.06 | — | 93.63 | |
| Qwen3-VL-32BTool Setting=w/ IID Tools2026.06 | — | 94.7 | |
| Qwen3-VL-32BTool Setting=w/ OOD Tools2026.06 | — | 95.15 | |
| Qwen3-VL-8BTool Setting=w/ IID Tools2026.06 | — | 89.8 | |
| Qwen3-VL-8BTool Setting=w/ OOD Tools2026.06 | — | 90.2 | |
| R1-Onevision-7BTool Setting=w/ IID Tools2026.06 | — | 83.2 | |
| R1-Onevision-7BTool Setting=w/ OOD Tools2026.06 | — | 83.9 | |
| ShareGPT4V 7BVIG training=false2026.02 | — | 26.15 | |
| ShareGPT4V 7B + VIG trainingVIG training=true2026.02 | — | 28.23 | |
| TikArt-8BTool Setting=w/ IID Tools2026.06 | — | 96.7 | |
| TikArt-8BTool Setting=w/ OOD Tools2026.06 | — | 94.7 | |
| VTool-R1-7BTool Setting=w/ IID Tools2026.06 | — | 93.1 | |
| VTool-R1-7BTool Setting=w/ OOD Tools2026.06 | — | 93.25 | |
| ZwZ-8BTool Setting=w/ IID Tools2026.06 | — | 96.8 | |
| ZwZ-8BTool Setting=w/ OOD Tools2026.06 | — | 95.6 |