Reranking on MTEB Reranking (test)
54.56MAP (AU)SBERT + MixSP
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| SBERT + MixSPBase Encoder=BERT-Base2024.06 | 54.56 | 30.59 | 75.78 | 42.39 | 50.83 | — | — | |
| SimCSE + MixSPBase Encoder=BERT-Base2024.06 | 54.5 | 30.68 | 75.35 | 43.51 | 51.01 | — | — | |
| SimCSE + MoEBase Encoder=BERT-Base2024.06 | 53.94 | 27.98 | 74.25 | 41.51 | 49.42 | — | — | |
| DiffAug + MixSPBase Encoder=BERT-Base2024.06 | 53.92 | 30.07 | 75.68 | 42.08 | 52.94 | — | — | |
| SBERT + MoEBase Encoder=BERT-Base2024.06 | 53.72 | 30 | 75.14 | 41.72 | 50.15 | — | — | |
| DiffAug + MoEBase Encoder=BERT-Base2024.06 | 52.68 | 29.83 | 74.76 | 40.52 | 49.45 | — | — | |
| SimCSE + FTBase Encoder=BERT-Base2024.06 | 51.81 | 28.91 | 70.07 | 38.19 | 47.25 | — | — | |
| SimCSEBase Encoder=BERT-Base2024.06 | 51.8 | 29.3 | 70.14 | 38.9 | 47.54 | — | — | |
| DiffAugBase Encoder=BERT-Base2024.06 | 51.1 | 29.52 | 71.1 | 37.81 | 47.38 | — | — | |
| SBERTBase Encoder=BERT-Base2024.06 | 51.09 | 30.24 | 69.4 | 36.54 | 46.82 | — | — | |
| DiffAug + FTBase Encoder=BERT-Base2024.06 | 51.04 | 29.44 | 69.82 | 36.34 | 46.66 | — | — | |
| ANCEContext Window=512, Temperature Scaling=false2024.10 | — | — | — | — | — | 49.09 | — | |
| ANCE + TempScaleContext Window=512, Temperature Scaling=true2024.10 | — | — | — | — | — | 49.25 | 0.32 | |
| BGEContext Window=512, Temperature Scaling=false2024.10 | — | — | — | — | — | 58.87 | — | |
| BGE + TempScaleContext Window=512, Temperature Scaling=true2024.10 | — | — | — | — | — | 58.97 | 0.17 | |
| E5Context Window=4k, Temperature Scaling=false2024.10 | — | — | — | — | — | 53.12 | — | |
| E5 + TempScaleContext Window=4k, Temperature Scaling=true2024.10 | — | — | — | — | — | 53.47 | 0.65 | |
| GISTContext Window=512, Temperature Scaling=false2024.10 | — | — | — | — | — | 58.55 | — | |
| GIST + TempScaleContext Window=512, Temperature Scaling=true2024.10 | — | — | — | — | — | 58.6 | 0.08 | |
| GTRContext Window=512, Temperature Scaling=false2024.10 | — | — | — | — | — | 54.23 | — | |
| GTR + TempScaleContext Window=512, Temperature Scaling=true2024.10 | — | — | — | — | — | 54.22 | -0.01 |