# Cross-lingual sentence retrieval on Tatoeba (test)

Source: [Cross-lingual sentence retrieval on Tatoeba (test)](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:09:07.143Z

Evaluation of cross-lingual sentence retrieval performance on the test split of the Tatoeba dataset, reporting scores across 22 specific language pairs plus an average.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Cross-lingual sentence retrieval |
| Dataset (including any stated split) | Tatoeba (test) |
| Metric | af |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 6 of 6 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [af](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=af>): Higher is better; unit: PERCENT.

- [bn](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=bn>): Higher is better; unit: PERCENT.

- [et](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=et>): Higher is better; unit: PERCENT.

- [eu](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=eu>): Higher is better; unit: PERCENT.

- [fi](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=fi>): Higher is better; unit: PERCENT.

- [he](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=he>): Higher is better; unit: PERCENT.

- [hu](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=hu>): Higher is better; unit: PERCENT.

- [id](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=id>): Higher is better; unit: PERCENT.

- [it](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=it>): Higher is better; unit: PERCENT.

- [jv](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=jv>): Higher is better; unit: PERCENT.

- [ja](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=ja>): Higher is better; unit: PERCENT.

- [ka](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=ka>): Higher is better; unit: PERCENT.

- [kk](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=kk>): Higher is better; unit: PERCENT.

- [ko](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=ko>): Higher is better; unit: PERCENT.

- [ml](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=ml>): Higher is better; unit: PERCENT.

- [mr](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=mr>): Higher is better; unit: PERCENT.

- [nl](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=nl>): Higher is better; unit: PERCENT.

- [fa](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=fa>): Higher is better; unit: PERCENT.

- [pt](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=pt>): Higher is better; unit: PERCENT.

- [ta](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=ta>): Higher is better; unit: PERCENT.

- [te](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=te>): Higher is better; unit: PERCENT.

- [tl](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=tl>): Higher is better; unit: PERCENT.

- [Avg Score](<https://www.sota2.com/research/sota/cross-lingual-sentence-retrieval-on-tatoeba-test.md?metric=Avg%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | af | Result date | Report paper |
| --- | --- | --- | --- |
| XLM-R | 55.2 | Not recorded | 68fa69ae1e209131cea23547 |
| XLM-R | 55 | Not recorded | 68fa69ae1e209131cea23547 |
| INFOXLM | 51.8 | Not recorded | 68fa69ae1e209131cea23547 |
| INFOXLM | 48.6 | Not recorded | 68fa69ae1e209131cea23547 |
| XLCO | 33.1 | Not recorded | 68fa69ae1e209131cea23547 |
| XLCO | 28.1 | Not recorded | 68fa69ae1e209131cea23547 |

### XLM-R

af: 55.2. Result ID: 698dcff48b517eb43323e623.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69ae1e209131cea23547.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67521e209131cea15706.md>)

Recorded evaluation configuration: {"Direction":"xx -\> en"}. This record does not assert independent reproduction.

### XLM-R

af: 55. Result ID: 698dcff48b517eb43323e626.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69ae1e209131cea23547.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67521e209131cea15706.md>)

Recorded evaluation configuration: {"Direction":"en -\> xx"}. This record does not assert independent reproduction.

### INFOXLM

af: 51.8. Result ID: 698dcff48b517eb43323e627.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69ae1e209131cea23547.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69ae1e209131cea23547.md>)

[Implementation](<https://aka.ms/infoxlm>)

Recorded evaluation configuration: {"Direction":"en -\> xx"}. This record does not assert independent reproduction.

### INFOXLM

af: 48.6. Result ID: 698dcff48b517eb43323e624.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69ae1e209131cea23547.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69ae1e209131cea23547.md>)

[Implementation](<https://aka.ms/infoxlm>)

Recorded evaluation configuration: {"Direction":"xx -\> en"}. This record does not assert independent reproduction.

### XLCO

af: 33.1. Result ID: 698dcff48b517eb43323e625.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69ae1e209131cea23547.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69ae1e209131cea23547.md>)

[Implementation](<https://aka.ms/infoxlm>)

Recorded evaluation configuration: {"Direction":"xx -\> en"}. This record does not assert independent reproduction.

### XLCO

af: 28.1. Result ID: 698dcff48b517eb43323e628.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69ae1e209131cea23547.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69ae1e209131cea23547.md>)

[Implementation](<https://aka.ms/infoxlm>)

Recorded evaluation configuration: {"Direction":"en -\> xx"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.