Summarization on MTEB English Summarization
32.17Main ScoreGIST + TempScale
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GIST + TempScaleContext Window=512, Temperature Scaling=true2024.10 | 32.17 | 3.31 | |
| BGE + TempScaleContext Window=512, Temperature Scaling=true2024.10 | 31.87 | 2.71 | |
| E5 + TempScaleContext Window=4k, Temperature Scaling=true2024.10 | 31.26 | 2.25 | |
| GISTContext Window=512, Temperature Scaling=false2024.10 | 31.14 | — | |
| BGEContext Window=512, Temperature Scaling=false2024.10 | 31.03 | — | |
| E5Context Window=4k, Temperature Scaling=false2024.10 | 30.58 | — | |
| GTR + TempScaleContext Window=512, Temperature Scaling=true2024.10 | 29.83 | 0.54 | |
| GTRContext Window=512, Temperature Scaling=false2024.10 | 29.67 | — | |
| ANCE + TempScaleContext Window=512, Temperature Scaling=true2024.10 | 29.59 | 0.06 | |
| ANCEContext Window=512, Temperature Scaling=false2024.10 | 29.58 | — |