Retrieval on MLDR (test)
35NDCG@10LMK
Evaluation results
| Method | Links | |
|---|---|---|
| LMKFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=322026.01 | 35 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=32, Evaluation Pool=LMK, Evaluation Granularity=322026.01 | 34.8 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=642026.01 | 34.7 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=256, Evaluation Granularity=2562026.01 | 34.6 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=256, Evaluation Pool=LMK, Evaluation Granularity=2562026.01 | 34.1 | |
| LMK pooling (Sentence)Finetuning Pool=LMK, Finetuning Granularity=Sentence, Evaluation Pool=LMK2026.01 | 33.7 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=64, Evaluation Pool=LMK, Evaluation Granularity=642026.01 | 33.6 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=128, Evaluation Granularity=1282026.01 | 32.9 | |
| ModernBERT-baseFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=322026.01 | 32.2 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=1282026.01 | 32.1 | |
| LMK pooling (Variable)Finetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Granularity=2562026.01 | 31.7 | |
| gte-en-mlm-baseFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=322026.01 | 31.4 | |
| MeanFinetuning Pool=Mean, Evaluation Pool=Mean2026.01 | 31.4 | |
| ModernBERT-baseFinetuning Pool=Mean, Evaluation Pool=Mean2026.01 | 31.3 | |
| MultiCLSFinetuning Pool=CLS, Evaluation Pool=MultiCLS2026.01 | 31 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=32, Evaluation Granularity=322026.01 | 31 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=128, Evaluation Pool=LMK, Evaluation Granularity=1282026.01 | 30.8 | |
| LMK pooling (Variable)Finetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Granularity=1282026.01 | 30.8 | |
| Latent AttnFinetuning Pool=Latent Attn, Evaluation Pool=Latent Attn2026.01 | 30.2 | |
| gte-en-mlm-baseFinetuning Pool=Mean, Evaluation Pool=Mean2026.01 | 30 | |
| ModernBERT-baseFinetuning Pool=CLS, Evaluation Pool=CLS2026.01 | 29.7 | |
| LMK pooling (Variable)Finetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Granularity=642026.01 | 29.7 | |
| Mean@kFinetuning Pool=Mean@k, Evaluation Pool=Mean@k2026.01 | 29.3 | |
| gte-en-mlm-baseFinetuning Pool=CLS, Evaluation Pool=CLS2026.01 | 29.1 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=2562026.01 | 28.7 | |
| MeanFinetuning Pool=Mean, Evaluation Pool=Mean2026.01 | 28 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=Sentence, Evaluation Pool=LMK, Evaluation Granularity=Sentence2026.01 | 28 | |
| LMK pooling (Variable)Finetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Granularity=322026.01 | 27.8 | |
| CLSFinetuning Pool=CLS, Evaluation Pool=CLS2026.01 | 27.3 | |
| CLSFinetuning Pool=CLS, Evaluation Pool=CLS2026.01 | 24.9 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=64, Evaluation Granularity=642026.01 | 24.7 | |
| Latent AttnFinetuning Pool=Latent Attn, Evaluation Pool=Latent Attn2026.01 | 24.5 | |
| Mean@kFinetuning Pool=Mean@k, Finetuning Granularity=64, Evaluation Pool=Mean@k, Evaluation Granularity=642026.01 | 15.7 | |
| MultiCLSFinetuning Pool=CLS, Evaluation Pool=MultiCLS, Evaluation Granularity=1282026.01 | 5.1 |