Information Retrieval on MTEB v2
45.9NDCG@10LMK
Evaluation Results
| Method | Links | |
|---|---|---|
| LMKFinetuning Pool=LMK, Finetuning Granularity=32, Evaluation Pool=LMK, Evaluation Granularity=322026.01 | 45.9 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=322026.01 | 45.8 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=642026.01 | 45.5 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=Sentence, Evaluation Pool=LMK, Evaluation Granularity=Sentence2026.01 | 45.4 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=64, Evaluation Pool=LMK, Evaluation Granularity=642026.01 | 45.1 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=1282026.01 | 45.1 | |
| LMK pooling (Sentence)Finetuning Pool=LMK, Finetuning Granularity=Sentence, Evaluation Pool=LMK2026.01 | 45 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=32, Evaluation Pool=LMK, Evaluation Granularity=322026.01 | 44.9 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=64, Evaluation Pool=LMK, Evaluation Granularity=642026.01 | 44.9 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=128, Evaluation Pool=LMK, Evaluation Granularity=1282026.01 | 44.9 | |
| LMK pooling (Variable)Finetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Granularity=2562026.01 | 44.8 | |
| CLSFinetuning Pool=CLS, Evaluation Pool=CLS2026.01 | 44.7 | |
| LMK pooling (Variable)Finetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Granularity=322026.01 | 44.7 | |
| LMK pooling (Variable)Finetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Granularity=642026.01 | 44.7 | |
| LMK pooling (Variable)Finetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Granularity=1282026.01 | 44.7 | |
| LMK poolingFinetuning Pool=LMK, Finetuning Granularity=256, Evaluation Pool=LMK, Evaluation Granularity=2562026.01 | 44.6 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=Variable, Evaluation Pool=LMK, Evaluation Granularity=2562026.01 | 44.5 | |
| CLSFinetuning Pool=CLS, Evaluation Pool=CLS2026.01 | 44.2 | |
| Mean@kFinetuning Pool=Mean@k, Finetuning Granularity=64, Evaluation Pool=Mean@k2026.01 | 44.2 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=128, Evaluation Pool=LMK, Evaluation Granularity=1282026.01 | 44 | |
| MeanFinetuning Pool=Mean, Evaluation Pool=Mean2026.01 | 43.9 | |
| Latent AttnFinetuning Pool=Latent Attn, Evaluation Pool=Latent Attn2026.01 | 43.8 | |
| MeanFinetuning Pool=Mean, Evaluation Pool=Mean2026.01 | 43.3 | |
| Latent AttnFinetuning Pool=Latent Attn, Evaluation Pool=Latent Attn2026.01 | 43.1 | |
| LMKFinetuning Pool=LMK, Finetuning Granularity=256, Evaluation Pool=LMK, Evaluation Granularity=2562026.01 | 42.8 | |
| MultiCLSFinetuning Pool=CLS, Evaluation Pool=MultiCLS, Evaluation Granularity=1282026.01 | 42.5 | |
| Mean@kFinetuning Pool=Mean@k, Finetuning Granularity=64, Evaluation Pool=Mean@k, Evaluation Granularity=642026.01 | 41.4 | |
| MultiCLSFinetuning Pool=CLS, Evaluation Pool=MultiCLS, Evaluation Granularity=1282026.01 | 31.2 |