Document Retrieval on MSMarco (dev)
43.2NDCG@10LMK pooling
Evaluation results
| Method | Links | |
|---|---|---|
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=128, Evaluation Pool=LMK, Evaluation Granularity=1282026.01 | 43.2 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=64, Evaluation Pool=LMK, Evaluation Granularity=642026.01 | 43 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=256, Evaluation Pool=LMK, Evaluation Granularity=2562026.01 | 43 | |
| LMK pooling (Variable)Finetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=322026.01 | 43 | |
| LMK pooling (Variable)Finetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=1282026.01 | 43 | |
| LMK pooling (Variable)Finetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=2562026.01 | 43 | |
| LMK pooling (Variable)Finetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=642026.01 | 42.9 | |
| MultiCLSFinetuning Pool=CLS, Evaluation Pool=MultiCLS, Evaluation Granularity=1282026.01 | 42.8 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=32, Evaluation Pool=LMK, Evaluation Granularity=322026.01 | 42.8 | |
| LMK pooling (Sentence)Finetuning Pool=LMK, Finetuning Granularity=Sentence, Evaluation Pool=LMK, Evaluation Granularity=Sentence2026.01 | 42.6 | |
| CLSFinetuning Pool=CLS, Evaluation Pool=CLS2026.01 | 42.3 | |
| MeanFinetuning Pool=Mean, Evaluation Pool=Mean2026.01 | 42.1 | |
| Latent AttnFinetuning Pool=Latent Attn, Evaluation Pool=Latent Attn2026.01 | 42 | |
| Mean@kFinetuning Pool=Mean@k, Finetuning Granularity=64, Evaluation Pool=Mean@k, Evaluation Granularity=642026.01 | 41.9 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=322026.01 | 40.3 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=642026.01 | 40.2 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=1282026.01 | 40.2 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=2562026.01 | 40.2 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=Sentence, Evaluation Pool=LMK, Evaluation Granularity=Sentence2026.01 | 40.2 | |
| Latent AttnFinetuning Pool=Latent Attn, Evaluation Pool=Latent Attn2026.01 | 40.1 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=128, Evaluation Pool=LMK, Evaluation Granularity=1282026.01 | 40 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=64, Evaluation Pool=LMK, Evaluation Granularity=642026.01 | 39.9 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=256, Evaluation Pool=LMK, Evaluation Granularity=2562026.01 | 39.9 | |
| CLSFinetuning Pool=CLS, Evaluation Pool=CLS2026.01 | 39.8 | |
| MeanFinetuning Pool=Mean, Evaluation Pool=Mean2026.01 | 39.8 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=32, Evaluation Pool=LMK, Evaluation Granularity=322026.01 | 39.7 | |
| MultiCLSFinetuning Pool=CLS, Evaluation Pool=MultiCLS, Evaluation Granularity=1282026.01 | 39 | |
| Mean@kFinetuning Pool=Mean@k, Finetuning Granularity=64, Evaluation Pool=Mean@k, Evaluation Granularity=642026.01 | 38.6 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=322026.01 | 28.9 | |
| gte-en-mlm-baseFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=322026.01 | 28.9 | |
| CLSFinetuning Pool=CLS, Finetuning Granularity=-, Evaluation Pool=CLS, Evaluation Granularity=-2026.01 | 28.7 | |
| gte-en-mlm-baseFinetuning Pool=CLS, Finetuning Granularity=-, Evaluation Pool=CLS, Evaluation Granularity=-2026.01 | 28.7 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=128, Evaluation Pool=LMK, Evaluation Granularity=1282026.01 | 28.6 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=642026.01 | 28.5 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=1282026.01 | 28.5 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=2562026.01 | 28.5 | |
| MeanFinetuning Pool=Mean, Finetuning Granularity=-, Evaluation Pool=Mean, Evaluation Granularity=-2026.01 | 28.3 | |
| gte-en-mlm-baseFinetuning Pool=Mean, Finetuning Granularity=-, Evaluation Pool=Mean, Evaluation Granularity=-2026.01 | 28.3 | |
| ModernBERT-baseFinetuning Pool=Mean, Finetuning Granularity=-, Evaluation Pool=Mean, Evaluation Granularity=-2026.01 | 26.1 | |
| ModernBERT-baseFinetuning Pool=CLS, Finetuning Granularity=-, Evaluation Pool=CLS, Evaluation Granularity=-2026.01 | 26 | |
| ModernBERT-baseFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=322026.01 | 26 |