Semantic Similarity on STS-B (test)
80.22Semantic ConsistencySimCSE-ROBERTa
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SimCSE-ROBERTa2024.04 | 80.22 | — | — | — | — | |
| Zipfian WhiteningBackbone=GloVe, Weighting=Zipfian2024.11 | 66.92 | — | — | — | — | |
| rematchInput=AMR2024.04 | 66.52 | — | — | — | — | |
| Zipfian WhiteningBackbone=Word2Vec, Weighting=Zipfian2024.11 | 66.5 | — | — | — | — | |
| SIF + CCRBackbone=Word2Vec2024.11 | 63.04 | — | — | — | — | |
| Zipfian CenteringBackbone=Word2Vec, Weighting=Zipfian2024.11 | 58.84 | — | — | — | — | |
| SIF + CCRBackbone=GloVe2024.11 | 58.7 | — | — | — | — | |
| ROBERTaPooling=first-last avg.2024.04 | 58.55 | — | — | — | — | |
| GloVeAggregation=avg.2024.04 | 58.02 | — | — | — | — | |
| Word2VecBackbone=Word2Vec, Post-processing=None2024.11 | 56.98 | — | — | — | — | |
| ABTTBackbone=Word2Vec2024.11 | 56.98 | — | — | — | — | |
| WhiteningBackbone=Word2Vec, Weighting=Uniform2024.11 | 56.03 | — | — | — | — | |
| CenteringBackbone=Word2Vec, Weighting=Uniform2024.11 | 55.85 | — | — | — | — | |
| ABTTBackbone=GloVe2024.11 | 54.28 | — | — | — | — | |
| Zipfian CenteringBackbone=GloVe, Weighting=Zipfian2024.11 | 52.25 | — | — | — | — | |
| WhiteningBackbone=GloVe, Weighting=Uniform2024.11 | 52.21 | — | — | — | — | |
| GloVeBackbone=GloVe, Post-processing=None2024.11 | 46.17 | — | — | — | — | |
| CenteringBackbone=GloVe, Weighting=Uniform2024.11 | 45.17 | — | — | — | — | |
| rematch2024.04 | — | 64.93 | 65.88 | 65.06 | 66.52 | |
| s2match2024.04 | — | 56.6 | 57.15 | 57.54 | 57.64 | |
| sembleu2024.04 | — | — | 58.62 | 58.17 | 58.95 | |
| smatch2024.04 | — | 53.84 | 54.67 | 54.73 | 55.16 | |
| WLK2024.04 | — | 63.18 | 64.6 | 64.33 | 65.37 |