Optical Character Recognition on OCRVQA (test)
74.87OCRVQA ScoreIndividual Grounding
Evaluation Results
| Method | Links | |
|---|---|---|
| Individual GroundingProtocol=full fine-tuning2025.05 | 74.87 | |
| TA w/ DAREMethod Class=Merging2025.05 | 72 | |
| Task ArithmeticMethod Class=Merging2025.05 | 71.78 | |
| TSV MergingMethod Class=Merging2025.05 | 71.65 | |
| Iso-CMethod Class=Merging2025.05 | 71.55 | |
| OptMergeMethod Class=Merging2025.05 | 71.48 | |
| WUDI MergingMethod Class=Merging2025.05 | 71.12 | |
| TIES MergingMethod Class=Merging2025.05 | 71.09 | |
| TIES w/ DAREMethod Class=Merging2025.05 | 70.93 | |
| Qwen2-VL-7B-GRPO-8kCheckpoint Type=Fine-tuned2025.05 | 68.85 | |
| olmOCR-7B-0225-previewCheckpoint Type=Fine-tuned2025.05 | 68.29 | |
| Individual Chart2025.05 | 67.9 | |
| Qwen2-VL-7B-PokemonCheckpoint Type=Fine-tuned2025.05 | 67.64 | |
| Individual OCR2025.05 | 67.32 | |
| Individual VQA2025.05 | 67.06 | |
| Individual Geometry2025.05 | 66.54 | |
| OptMerge2025.05 | 66.37 | |
| EraX-VL-7B-V1.0Checkpoint Type=Fine-tuned2025.05 | 65.59 | |
| WUDI MergingMerging Method=WUDI2025.05 | 65.56 | |
| Qwen2-VL-InstructMethod Class=Baseline2025.05 | 65.42 | |
| Qwen2.5-VL-32B-Instruct2025.05 | 64.58 | |
| Individual Grounding2025.05 | 64.19 | |
| Mixture TrainingProtocol=full fine-tuning2025.05 | 60.25 | |
| OptMergeMerging Method=Optimization-based Merging2025.05 | 60.06 | |
| Individual OCRProtocol=full fine-tuning2025.05 | 54.79 | |
| Iso-CProtocol=full fine-tuning2025.05 | 46.51 | |
| OptMergeProtocol=full fine-tuning2025.05 | 46.35 | |
| WUDI MergingProtocol=full fine-tuning2025.05 | 46.12 | |
| TSV MergingProtocol=full fine-tuning2025.05 | 45.38 | |
| TIES MergingProtocol=full fine-tuning2025.05 | 44.01 | |
| Task ArithmeticProtocol=full fine-tuning2025.05 | 43.39 | |
| TIES w/ DAREProtocol=full fine-tuning2025.05 | 43.33 | |
| TA w/ DAREProtocol=full fine-tuning2025.05 | 43.03 | |
| Weight AverageProtocol=full fine-tuning2025.05 | 41.86 | |
| InternVL2.5-InstructProtocol=full fine-tuning2025.05 | 41.08 | |
| Individual VQAProtocol=full fine-tuning2025.05 | 36.04 | |
| Individual GeometryProtocol=full fine-tuning2025.05 | 35.35 | |
| Individual ChartProtocol=full fine-tuning2025.05 | 34.83 |