Text-to-text Retrieval on MMDocRAG (test)
67.4MRRQwen2
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Qwen2Adaptation=SKR2026.04 | 67.4 | 56.6 | 75.6 | 81.4 | 86 | |
| Llama3.1Adaptation=SKR2026.04 | 66.9 | 56.6 | 74.2 | 79.2 | 84.8 | |
| Phi-3Adaptation=SKR2026.04 | 63.2 | 51.8 | 71.8 | 77.8 | 82.6 | |
| Mistral-0.2Adaptation=SKR2026.04 | 62.2 | 51 | 70.2 | 75.4 | 82.2 | |
| Nomic-text-v22026.04 | 54.9 | 45.4 | 60 | 64.8 | 72.8 | |
| Nomic-text-v1.52026.04 | 49.5 | 39.2 | 55.8 | 62.4 | 70.2 | |
| OpenAI ada-0022026.04 | 42 | 32.2 | 46 | 51.8 | 59.8 | |
| Llama3.1Adaptation=E5-V2026.04 | 30.6 | 24 | 31.8 | 36 | 42.6 | |
| Qwen2Adaptation=E5-V2026.04 | 27 | 19.6 | 29.4 | 33.6 | 41.6 | |
| Mistral-0.2Adaptation=E5-V2026.04 | 22.3 | 14.4 | 25 | 29.2 | 38.6 | |
| Phi-3Adaptation=E5-V2026.04 | 20.9 | 14.2 | 23 | 27 | 33.8 | |
| Llama3.1Adaptation=SFT2026.04 | 19.7 | 14 | 21 | 25.6 | 32.8 | |
| Llama3.1Adaptation=Base2026.04 | 19.6 | 13.6 | 21.4 | 25.8 | 33 | |
| Qwen2Adaptation=Base2026.04 | 11.5 | 6.2 | 13 | 16.4 | 23 | |
| Mistral-0.2Adaptation=Base2026.04 | 10.8 | 5.2 | 11.6 | 15.4 | 20.4 | |
| Phi-3Adaptation=Base2026.04 | 9.8 | 6.8 | 9.6 | 11.2 | 14.6 | |
| Phi-3Adaptation=SFT2026.04 | 8.2 | 5.4 | 8.4 | 10 | 12.4 | |
| Mistral-0.2Adaptation=SFT2026.04 | 7.6 | 3.6 | 7.8 | 10.4 | 15.2 | |
| Qwen2Adaptation=SFT2026.04 | 6.3 | 3.2 | 5.6 | 9 | 13.6 |