Document Retrieval on MIRACL (dev)
49NDCG@10LMK pooling
Evaluation results
| Method | Links | |
|---|---|---|
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=256, Evaluation Granularity=2562026.01 | 49 | |
| CLSFinetuning Pool=CLS, Evaluation Pool=CLS2026.01 | 48.7 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=322026.01 | 48.6 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=642026.01 | 48.6 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=32, Evaluation Pool=LMK, Evaluation Granularity=322026.01 | 48.5 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=128, Evaluation Pool=LMK, Evaluation Granularity=1282026.01 | 48.4 | |
| Latent AttnFinetuning Pool=Latent Attn, Evaluation Pool=Latent Attn2026.01 | 48.3 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=64, Evaluation Pool=LMK, Evaluation Granularity=642026.01 | 48.2 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=Sentence, Evaluation Pool=LMK, Evaluation Granularity=Sentence2026.01 | 48.2 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=1282026.01 | 48.1 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=2562026.01 | 48.1 | |
| LMK pooling (Variable)Finetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Granularity=2562026.01 | 48.1 | |
| MeanFinetuning Pool=Mean, Evaluation Pool=Mean2026.01 | 48 | |
| CLSFinetuning Pool=CLS, Evaluation Pool=CLS2026.01 | 47.9 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=128, Evaluation Granularity=1282026.01 | 47.1 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=256, Evaluation Pool=LMK, Evaluation Granularity=2562026.01 | 47 | |
| LMK pooling (Variable)Finetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Granularity=1282026.01 | 47 | |
| LMK pooling (Sentence)Finetuning Pool=LMK, Finetuning Granularity=Sentence, Evaluation Pool=LMK2026.01 | 46.9 | |
| Mean@kFinetuning Pool=Mean@k, Evaluation Pool=Mean@k2026.01 | 46.8 | |
| LMK pooling (Variable)Finetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Granularity=322026.01 | 46.7 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=32, Evaluation Granularity=322026.01 | 46.4 | |
| LMK pooling (Variable)Finetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Granularity=642026.01 | 46.4 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=64, Evaluation Granularity=642026.01 | 46.3 | |
| MeanFinetuning Pool=Mean, Evaluation Pool=Mean2026.01 | 45.6 | |
| Latent AttnFinetuning Pool=Latent Attn, Evaluation Pool=Latent Attn2026.01 | 44.9 | |
| Mean@kFinetuning Pool=Mean@k, Finetuning Granularity=64, Evaluation Pool=Mean@k, Evaluation Granularity=642026.01 | 44.1 | |
| MultiCLSFinetuning Pool=CLS, Evaluation Pool=MultiCLS2026.01 | 42.6 | |
| ModernBERT-baseFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=322026.01 | 33.1 | |
| CLSFinetuning Pool=CLS, Finetuning Granularity=-, Evaluation Pool=CLS, Evaluation Granularity=-2026.01 | 32.3 | |
| gte-en-mlm-baseFinetuning Pool=CLS, Evaluation Pool=CLS2026.01 | 32.3 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=322026.01 | 32.1 | |
| gte-en-mlm-baseFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=322026.01 | 32.1 | |
| ModernBERT-baseFinetuning Pool=CLS, Evaluation Pool=CLS2026.01 | 32 | |
| ModernBERT-baseFinetuning Pool=Mean, Evaluation Pool=Mean2026.01 | 31.4 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=1282026.01 | 31.1 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=642026.01 | 31 | |
| MultiCLSFinetuning Pool=CLS, Evaluation Pool=MultiCLS, Evaluation Granularity=1282026.01 | 31 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=2562026.01 | 30.4 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=128, Evaluation Pool=LMK, Evaluation Granularity=1282026.01 | 30.1 | |
| MeanFinetuning Pool=Mean, Finetuning Granularity=-, Evaluation Pool=Mean, Evaluation Granularity=-2026.01 | 29 | |
| gte-en-mlm-baseFinetuning Pool=Mean, Evaluation Pool=Mean2026.01 | 29 |