List your company
ResearchFormerly WizWand

Optical Character Recognition on OCRVQA (test)

74.87OCRVQA ScoreIndividual Grounding
33.228444.039254.8565.6608May 26, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Individual GroundingProtocol=full fine-tuning2025.0574.87
TA w/ DAREMethod Class=Merging2025.0572
Task ArithmeticMethod Class=Merging2025.0571.78
TSV MergingMethod Class=Merging2025.0571.65
Iso-CMethod Class=Merging2025.0571.55
OptMergeMethod Class=Merging2025.0571.48
WUDI MergingMethod Class=Merging2025.0571.12
TIES MergingMethod Class=Merging2025.0571.09
TIES w/ DAREMethod Class=Merging2025.0570.93
Qwen2-VL-7B-GRPO-8kCheckpoint Type=Fine-tuned2025.0568.85
olmOCR-7B-0225-previewCheckpoint Type=Fine-tuned2025.0568.29
Individual Chart2025.0567.9
Qwen2-VL-7B-PokemonCheckpoint Type=Fine-tuned2025.0567.64
Individual OCR2025.0567.32
Individual VQA2025.0567.06
Individual Geometry2025.0566.54
OptMerge2025.0566.37
EraX-VL-7B-V1.0Checkpoint Type=Fine-tuned2025.0565.59
WUDI MergingMerging Method=WUDI2025.0565.56
Qwen2-VL-InstructMethod Class=Baseline2025.0565.42
Qwen2.5-VL-32B-Instruct2025.0564.58
Individual Grounding2025.0564.19
Mixture TrainingProtocol=full fine-tuning2025.0560.25
OptMergeMerging Method=Optimization-based Merging2025.0560.06
Individual OCRProtocol=full fine-tuning2025.0554.79
Iso-CProtocol=full fine-tuning2025.0546.51
OptMergeProtocol=full fine-tuning2025.0546.35
WUDI MergingProtocol=full fine-tuning2025.0546.12
TSV MergingProtocol=full fine-tuning2025.0545.38
TIES MergingProtocol=full fine-tuning2025.0544.01
Task ArithmeticProtocol=full fine-tuning2025.0543.39
TIES w/ DAREProtocol=full fine-tuning2025.0543.33
TA w/ DAREProtocol=full fine-tuning2025.0543.03
Weight AverageProtocol=full fine-tuning2025.0541.86
InternVL2.5-InstructProtocol=full fine-tuning2025.0541.08
Individual VQAProtocol=full fine-tuning2025.0536.04
Individual GeometryProtocol=full fine-tuning2025.0535.35
Individual ChartProtocol=full fine-tuning2025.0534.83