# Semantic Textual Similarity on STS22

Source: [Semantic Textual Similarity on STS22](<https://www.sota2.com/research/sota/semantic-textual-similarity-on-sts22>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-19T10:32:17.074Z

Evaluation of Semantic Textual Similarity performance on the STS22 dataset, measured using Pearson correlation.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Semantic Textual Similarity |
| Dataset (including any stated split) | STS22 |
| Metric | Pearson Correlation |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Pearson Correlation](<https://www.sota2.com/research/sota/semantic-textual-similarity-on-sts22.md?metric=Pearson%20Correlation>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Pearson Correlation | Result date | Report paper |
| --- | --- | --- | --- |
| E5-MISTRAL with LiRA | 76.55 | Not recorded | 68fa7c281e209131cea8cbd9 |
| QWEN3-E-8B with LiRA | 75 | Not recorded | 68fa7c281e209131cea8cbd9 |
| QWEN3-E-8B | 71.64 | Not recorded | 68fa7c281e209131cea8cbd9 |
| E5-MISTRAL | 71.37 | Not recorded | 68fa7c281e209131cea8cbd9 |
| LUSIFER | 70.49 | Not recorded | 68fa7c281e209131cea8cbd9 |
| GTR-XXL | 60.11 | Not recorded | 68fa7c281e209131cea8cbd9 |
| GTE-LARGE with LiRA | 59.17 | Not recorded | 68fa7c281e209131cea8cbd9 |
| ST5-XXL | 59.02 | Not recorded | 68fa7c281e209131cea8cbd9 |
| E5-LARGE | 54.31 | Not recorded | 68fa7c281e209131cea8cbd9 |
| BGE-EN-1.5 with LiRA | 53.94 | Not recorded | 68fa7c281e209131cea8cbd9 |
| GTE-LARGE | 53.79 | Not recorded | 68fa7c281e209131cea8cbd9 |
| BGE-EN-1.5 | 50.77 | Not recorded | 68fa7c281e209131cea8cbd9 |
| CONTRIEVER | 41.72 | Not recorded | 68fa7c281e209131cea8cbd9 |
| SIMCSE | 37.95 | Not recorded | 68fa7c281e209131cea8cbd9 |

### E5-MISTRAL with LiRA

Pearson Correlation: 76.55. Result ID: 6a0c3adefbc373592c02f7fd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Backbone":"E5-MISTRAL","LiRA integration":"true"}. This record does not assert independent reproduction.

### QWEN3-E-8B with LiRA

Pearson Correlation: 75. Result ID: 6a0c3adefbc373592c02f800.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Backbone":"QWEN3-E-8B","LiRA integration":"true"}. This record does not assert independent reproduction.

### QWEN3-E-8B

Pearson Correlation: 71.64. Result ID: 6a0c3adefbc373592c02f7ff.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Year":"2025"}. This record does not assert independent reproduction.

### E5-MISTRAL

Pearson Correlation: 71.37. Result ID: 6a0c3adefbc373592c02f7fc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Year":"2024"}. This record does not assert independent reproduction.

### LUSIFER

Pearson Correlation: 70.49. Result ID: 6a0c3adefbc373592c02f7fe.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Year":"2025"}. This record does not assert independent reproduction.

### GTR-XXL

Pearson Correlation: 60.11. Result ID: 6a0c3adefbc373592c02f7f5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Year":"2021"}. This record does not assert independent reproduction.

### GTE-LARGE with LiRA

Pearson Correlation: 59.17. Result ID: 6a0c3adefbc373592c02f7f8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Backbone":"GTE-LARGE","LiRA integration":"true"}. This record does not assert independent reproduction.

### ST5-XXL

Pearson Correlation: 59.02. Result ID: 6a0c3adefbc373592c02f7f4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Year":"2021"}. This record does not assert independent reproduction.

### E5-LARGE

Pearson Correlation: 54.31. Result ID: 6a0c3adefbc373592c02f7fb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Year":"2024"}. This record does not assert independent reproduction.

### BGE-EN-1.5 with LiRA

Pearson Correlation: 53.94. Result ID: 6a0c3adefbc373592c02f7fa.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Backbone":"BGE-EN-1.5","LiRA integration":"true"}. This record does not assert independent reproduction.

### GTE-LARGE

Pearson Correlation: 53.79. Result ID: 6a0c3adefbc373592c02f7f7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Year":"2023"}. This record does not assert independent reproduction.

### BGE-EN-1.5

Pearson Correlation: 50.77. Result ID: 6a0c3adefbc373592c02f7f9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Year":"2023"}. This record does not assert independent reproduction.

### CONTRIEVER

Pearson Correlation: 41.72. Result ID: 6a0c3adefbc373592c02f7f6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Year":"2022"}. This record does not assert independent reproduction.

### SIMCSE

Pearson Correlation: 37.95. Result ID: 6a0c3adefbc373592c02f7f3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Year":"2021"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
