Retrieval on FinSlides
61.6NDCG@5RobTab ColQwen
Evaluation results
| Method | Links | |
|---|---|---|
| RobTab ColQwenFine-tuning Data=Rephrased + Table-heavy (RobTab), Input Processing=Vision, Rephrasing Level=Level 32025.02 | 61.6 | |
| RobTab ColPaliFine-tuning Data=Rephrased + Table-heavy (RobTab), Input Processing=Vision, Rephrasing Level=Level 32025.02 | 58.3 | |
| Tab ColQwenFine-tuning Data=Table-heavy dataset (Tab), Input Processing=Vision, Rephrasing Level=Level 32025.02 | 49.6 | |
| Rob ColPaliFine-tuning Data=Rephrased dataset (Rob), Input Processing=Vision, Rephrasing Level=Level 32025.02 | 48.4 | |
| Rob ColQwenFine-tuning Data=Rephrased dataset (Rob), Input Processing=Vision, Rephrasing Level=Level 32025.02 | 44.3 | |
| Tab ColPaliFine-tuning Data=Table-heavy dataset (Tab), Input Processing=Vision, Rephrasing Level=Level 32025.02 | 41.5 | |
| ColQwenInput Processing=Vision, Rephrasing Level=Level 32025.02 | 31.1 | |
| ColPaliInput Processing=Vision, Rephrasing Level=Level 32025.02 | 27.6 | |
| BGE-M3 (Captioning)Input Processing=Captioning, Rephrasing Level=Level 32025.02 | 13.8 | |
| BGE-M3 (OCR)Input Processing=OCR, Rephrasing Level=Level 32025.02 | 11.4 | |
| BM25 (Captioning)Input Processing=Captioning, Rephrasing Level=Level 32025.02 | 9.9 | |
| BM25 (OCR)Input Processing=OCR, Rephrasing Level=Level 32025.02 | 5.9 |