Information Retrieval on MIRACL Bengali (dev)
0.727NDCG@10e5-base
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| e5-baseRetrieval Method=raw, Kcands=200, Corpus size (|C|)=297k2026.06 | 0.727 | — | — | — | |
| e5-smallRetrieval Method=raw, Kcands=200, Corpus size (|C|)=297k2026.06 | 0.688 | — | — | — | |
| Indic-ColBERTzero-shot=true2023.12 | 0.606 | 0.894 | — | — | |
| mColBERTzero-shot=true2023.12 | 0.546 | 0.913 | — | — | |
| BM25Source=Official scores2023.12 | 0.508 | 0.909 | — | — | |
| mDPRSource=Official scores2023.12 | 0.443 | 0.819 | — | — | |
| SHARDEncoder=e5-base, Prefix Size=d/4, Kcands=200, Corpus size (|C|)=297k2026.06 | — | — | 0 | 0 | |
| SHARDEncoder=e5-base, Prefix Size=d/8, Kcands=200, Corpus size (|C|)=297k2026.06 | — | — | 0.001 | 0.006 | |
| SHARDEncoder=e5-small, Prefix Size=d/4, Kcands=200, Corpus size (|C|)=297k2026.06 | — | — | 0.008 | 0.017 | |
| SHARDEncoder=e5-small, Prefix Size=d/8, Kcands=200, Corpus size (|C|)=297k2026.06 | — | — | 0.104 | 0.131 | |
| SVDEncoder=e5-base, Prefix Size=k=d/2, Kcands=200, Corpus size (|C|)=297k2026.06 | — | — | 0.03 | 0.042 | |
| SVDEncoder=e5-small, Prefix Size=k=d/2, Kcands=200, Corpus size (|C|)=297k2026.06 | — | — | 0.051 | 0.067 |