Semantic Textual Similarity on MTEB English 2023 (test)
89.37BIOData-CUBE
Evaluation Results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Data-CUBEModel Category=Instruction-based Sentence Representation Model, Base Model=INS, Data Augmentation=+Data-Cube2024.01 | 89.37 | 82.52 | 78.46 | 88.39 | 83.06 | 89.46 | 85.87 | 91.08 | 68.28 | 87.61 | 84.41 | |
| GTEModel Category=Instruction-based Sentence Representation Model2024.01 | 88.65 | 79.81 | 76.81 | 88.11 | 82.66 | 88.93 | 84.25 | 88.47 | 69.71 | 86.07 | 83.35 | |
| OpenAI-TEModel Category=Sentence Representation API2024.01 | 86.35 | 80.6 | 69.8 | 83.27 | 76.09 | 86.12 | 85.96 | 90.25 | 68.12 | 83.17 | 80.97 | |
| StellaModel Category=Instruction-based Sentence Representation Model2024.01 | 85.94 | 81.06 | 78.72 | 84.88 | 83.11 | 88.74 | 86.35 | 87.71 | 66.28 | 87.45 | 83.02 | |
| EmberModel Category=Sentence Representation API2024.01 | 85.81 | 81.75 | 78.51 | 86.62 | 83.06 | 88.39 | 86.82 | 87.9 | 66.76 | 87.77 | 83.34 | |
| UdeverModel Category=Instruction-based Sentence Representation Model2024.01 | 85.52 | 81.41 | 77.47 | 86.38 | 81.17 | 88.23 | 86.29 | 90.62 | 65.01 | 88.02 | 83.01 | |
| CohereModel Category=Sentence Representation API2024.01 | 85.01 | 82.18 | 77.62 | 85.16 | 80.02 | 88.92 | 86.92 | 90.09 | 66.81 | 88.79 | 83.15 | |
| VoyageModel Category=Sentence Representation API2024.01 | 84.85 | 79.71 | 77.09 | 88.91 | 82.08 | 89.21 | 84.74 | 90.73 | 62.1 | 89.86 | 82.93 | |
| E5Model Category=No-Instruction Sentence Representation Model2024.01 | 84.73 | 80.49 | 75.93 | 85.22 | 80.54 | 88.81 | 85.28 | 89.37 | 62.99 | 87.21 | 82.06 | |
| BGEModel Category=Instruction-based Sentence Representation Model2024.01 | 84.65 | 81.68 | 79.05 | 86.37 | 82.78 | 88.03 | 86.49 | 87.5 | 67.05 | 87.52 | 83.11 | |
| JinaModel Category=Instruction-based Sentence Representation Model2024.01 | 84.43 | 79.2 | 74.52 | 83.16 | 78.09 | 86.91 | 83.65 | 90.16 | 64.88 | 84.6 | 80.96 | |
| INSModel Category=Instruction-based Sentence Representation Model2024.01 | 84.39 | 81.27 | 76.28 | 88.18 | 81.92 | 89.01 | 85.49 | 90.3 | 67.74 | 86.88 | 83.15 | |
| ContrieverModel Category=No-Instruction Sentence Representation Model2024.01 | 83.32 | 70.2 | 64.34 | 80.03 | 74.51 | 83.3 | 79.67 | 86.32 | 64.64 | 78.81 | 76.51 | |
| GTRModel Category=No-Instruction Sentence Representation Model2024.01 | 81.91 | 74.29 | 70.12 | 82.72 | 78.24 | 86.26 | 81.61 | 85.18 | 65.76 | 77.73 | 78.38 | |
| SentenceT5Model Category=No-Instruction Sentence Representation Model2024.01 | 80.43 | 80.47 | 78.85 | 88.94 | 84.86 | 89.32 | 84.67 | 89.46 | 65.33 | 84.01 | 82.63 | |
| SGPTModel Category=No-Instruction Sentence Representation Model2024.01 | 79.5 | 79.59 | 74.29 | 85.35 | 79.21 | 85.52 | 82.54 | 90.44 | 63.2 | 85.67 | 80.53 | |
| USEModel Category=No-Instruction Sentence Representation Model2024.01 | 78.19 | 74.43 | 72.58 | 72.22 | 69.98 | 82.22 | 76.91 | 85.22 | 61.9 | 80.28 | 75.39 | |
| SimCSEModel Category=No-Instruction Sentence Representation Model2024.01 | 68.38 | 80.77 | 75.3 | 84.67 | 80.19 | 85.4 | 80.82 | 89.44 | 61.96 | 84.25 | 79.12 | |
| GloVeModel Category=No-Instruction Sentence Representation Model2024.01 | 44.93 | 55.43 | 54.64 | 69.16 | 60.81 | 72.31 | 65.34 | 77.95 | 56.35 | 61.54 | 61.85 |