Semantic Textual Similarity on MTEB English STS subsets
75.88Average STS ScoreBGE
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| BGEContext Window=512, Temperature Scaling=false2024.10 | 75.88 | — | |
| BGE + TempScaleContext Window=512, Temperature Scaling=true2024.10 | 75.68 | -0.26 | |
| GISTContext Window=512, Temperature Scaling=false2024.10 | 75.61 | — | |
| GIST + TempScaleContext Window=512, Temperature Scaling=true2024.10 | 75.61 | -0.01 | |
| E5 + TempScaleContext Window=4k, Temperature Scaling=true2024.10 | 72.17 | 0.55 | |
| E5Context Window=4k, Temperature Scaling=false2024.10 | 71.77 | — | |
| GTR + TempScaleContext Window=512, Temperature Scaling=true2024.10 | 70.26 | 0.21 | |
| GTRContext Window=512, Temperature Scaling=false2024.10 | 70.11 | — | |
| ANCE + TempScaleContext Window=512, Temperature Scaling=true2024.10 | 66.47 | 0.22 | |
| ANCEContext Window=512, Temperature Scaling=false2024.10 | 66.32 | — |