Textual RAG on BizMMRAG Japanese (test)
85TXT ScoreQwen2.5-VL-72B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen2.5-VL-72BBackbone=Qwen2.5-VL-72B, Layout Analysis=None2025.05 | 85 | 52.3 | 69.1 | 68.8 | |
| SCAN-Qwen2.5-VL-72BBackbone=Qwen2.5-VL-72B, Layout Analysis=SCAN2025.05 | 81.7 | 72.7 | 73.8 | 76.1 | |
| DiT-Qwen2.5-VL-72BBackbone=Qwen2.5-VL-72B, Layout Analysis=DiT2025.05 | 75 | 54.6 | 50 | 59.9 | |
| Beehive-Qwen2.5-VL-72BBackbone=Qwen2.5-VL-72B, Layout Analysis=Beehive2025.05 | 70 | 29.6 | 21.4 | 40.3 | |
| DocLayout-YOLO-Qwen2.5-VL-72BBackbone=Qwen2.5-VL-72B, Layout Analysis=DocLayout-YOLO2025.05 | 61.7 | 25 | 28.6 | 38.4 |