List your company
ResearchFormerly WizWand

Multi-page Document Question Answering on MP-DocVQA (test)

0.8458ANLSAVIR
0.385080.504690.62430.74391Jun 1, 2023Nov 8, 2023Apr 16, 2024Sep 23, 2024Mar 2, 2025Aug 9, 2025Jan 17, 2026
Updated 8mo ago

Evaluation results

MethodLinks
AVIROCR=false, Params.=3B2026.010.845881.55
M3DOCRAGYear=2024, OCR=false, Params.=8B2026.010.844481.05
Qwen2.5-3B-AWQYear=2025, OCR=false, Params.=3B2026.010.8405—
Arctic-TILTYear=2024, OCR=true, Params.=800M2026.010.8122—
GRAMYear=2024, OCR=true, Params.=859M2026.010.8032—
ScreenAIYear=2024, OCR=true, Params.=5B2026.010.771177.88
ScreenAIOCR Usage=With OCR2024.020.771—
ScreenAIOCR Usage=Without OCR2024.020.729—
RMT5Year=2024, OCR=true, Params.=312M2026.010.640188.32
Hi-VT5Paradigm=Fine-tuning, Setup=Multipage2023.060.6201—
Hi-VT5Year=2023, OCR=true, Params.=316M2026.010.620179.23
SelfAttnScoringYear=2024, OCR=false, Params.=273M2026.010.619981.55
Hi-VT5OCR Usage=SOTA Overall2024.020.618—
Hi-VT5OCR Usage=With OCR2024.020.618—
Claude + LATIN-PromptParadigm=Zero-shot, Setup=Max Conf2023.060.6129—
Big BirdParadigm=Fine-tuning, Setup=Max Conf2023.060.5854—
Big BirdYear=2020, OCR=true, Params.=131M2026.010.585472.27
LayoutLMv3Paradigm=Fine-tuning, Setup=Max Conf2023.060.5513—
LayoutLMv3Year=2022, OCR=true, Params.=125M2026.010.551374.02
LongformerParadigm=Fine-tuning, Setup=Max Conf2023.060.5506—
LongformerYear=2020, OCR=true, Params.=148M2026.010.550670.37
BERTParadigm=Fine-tuning, Setup=Max Conf2023.060.5347—
BERTYear=2018, OCR=true, Params.=334M2026.010.534771.24
LongformerParadigm=Fine-tuning, Setup=Concat2023.060.5287—
T5Paradigm=Fine-tuning, Setup=Concat2023.060.505—
Big BirdParadigm=Fine-tuning, Setup=Concat2023.060.4929—
LayoutLMv3Paradigm=Fine-tuning, Setup=Concat2023.060.4538—
BERTParadigm=Fine-tuning, Setup=Concat2023.060.4183—
T5Paradigm=Fine-tuning, Setup=Max Conf2023.060.4028—
T5Year=2020, OCR=true, Params.=223M2026.010.402846.05