Retrieval on FinReport
67.1NDCG@5RobTab ColQwen
Evaluation results
| Method | Links | |
|---|---|---|
| RobTab ColQwenFine-tuning Data=Rephrased + Table-heavy (RobTab), Input Processing=Vision, Rephrasing Level=Level 32025.02 | 67.1 | |
| RobTab ColPaliFine-tuning Data=Rephrased + Table-heavy (RobTab), Input Processing=Vision, Rephrasing Level=Level 32025.02 | 63.2 | |
| Tab ColQwenFine-tuning Data=Table-heavy dataset (Tab), Input Processing=Vision, Rephrasing Level=Level 32025.02 | 54 | |
| Tab ColPaliFine-tuning Data=Table-heavy dataset (Tab), Input Processing=Vision, Rephrasing Level=Level 32025.02 | 50.5 | |
| Rob ColQwenFine-tuning Data=Rephrased dataset (Rob), Input Processing=Vision, Rephrasing Level=Level 32025.02 | 47.5 | |
| Rob ColPaliFine-tuning Data=Rephrased dataset (Rob), Input Processing=Vision, Rephrasing Level=Level 32025.02 | 47.1 | |
| ColQwenInput Processing=Vision, Rephrasing Level=Level 32025.02 | 41.8 | |
| BGE-M3 (OCR)Input Processing=OCR, Rephrasing Level=Level 32025.02 | 36.5 | |
| BGE-M3 (Captioning)Input Processing=Captioning, Rephrasing Level=Level 32025.02 | 35.9 | |
| ColPaliInput Processing=Vision, Rephrasing Level=Level 32025.02 | 34.5 | |
| BM25 (Captioning)Input Processing=Captioning, Rephrasing Level=Level 32025.02 | 25.3 | |
| BM25 (OCR)Input Processing=OCR, Rephrasing Level=Level 32025.02 | 21.7 |