Sentence Embedding Clustering on MTEB (test)
63.48AskU. Scoreinstructor-large
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| instructor-large2024.02 | 63.48 | 81.83 | 50.5 | 53.51 | 62.33 | |
| llama-2-7b-w/o-processencoding_method=1st-gen, layer=last, processing=none2024.02 | 61.25 | 83.13 | 44.39 | 50.68 | 59.86 | |
| llama-2-7b-INBEDDERencoding_method=1st-gen, layer=last2024.02 | 60.32 | 80.61 | 44.77 | 52.33 | 59.51 | |
| opt-2.7b-INBEDDERencoding_method=1st-gen, layer=last2024.02 | 59.94 | 75.33 | 41.93 | 49.07 | 56.57 | |
| opt-1.3b-INBEDDERencoding_method=1st-gen, layer=last2024.02 | 59.09 | 71.33 | 43.08 | 46.45 | 54.99 | |
| e5-large-v2instruction=without2024.02 | 59.01 | 83.84 | 50.6 | 47.94 | 60.35 | |
| roberta-large-alpacaencoding_method=avg-gen, layer=last2024.02 | 56.29 | 73.02 | 41.66 | 40.61 | 52.9 | |
| opt-1.3b-alpacaencoding_method=avg-gen, layer=last2024.02 | 55.89 | 69.68 | 42.43 | 38.49 | 51.62 | |
| opt-2.7b-alpacaencoding_method=avg-gen, layer=last2024.02 | 55.65 | 76.26 | 42.45 | 32.11 | 51.62 | |
| roberta-large-INBEDDERencoding_method=avg-gen, layer=last2024.02 | 55.5 | 73.8 | 41 | 41.93 | 53.06 | |
| llama-2-7b-chatencoding_method=re-enc, layer=last2024.02 | 55.26 | 75.81 | 41.43 | 25.34 | 49.46 | |
| llama-2-13b-chatencoding_method=re-enc, layer=last2024.02 | 53.69 | 77.64 | 38.84 | 30.77 | 50.24 |