# Natural Language Inference on XNLI Sw (test)

Source: [Natural Language Inference on XNLI Sw (test)](<https://www.sota2.com/research/sota/natural-language-inference-on-xnli-sw-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:29:53.479Z

Evaluation of Natural Language Inference performance on the Swahili subset of the XNLI test set, typically measured by accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Natural Language Inference |
| Dataset (including any stated split) | XNLI Sw (test) |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 18 of 18 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/natural-language-inference-on-xnli-sw-test.md?metric=Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| Tpl-div-k | 65.34 | Not recorded | 68fa74281e209131cea6014e |
| SRC+GEN | 64.3 | Not recorded | 68fa74281e209131cea6014e |
| Tpl-rand-k | 64.11 | Not recorded | 68fa74281e209131cea6014e |
| T-div-k | 64.1 | Not recorded | 68fa74281e209131cea6014e |
| Tpl-top-k | 63.78 | Not recorded | 68fa74281e209131cea6014e |
| SRC+GEN | 63.64 | Not recorded | 68fa74281e209131cea6014e |
| T-top-k | 62.94 | Not recorded | 68fa74281e209131cea6014e |
| T-top-k | 62.9 | Not recorded | 68fa74281e209131cea6014e |
| Tpl-rand-k | 62.49 | Not recorded | 68fa74281e209131cea6014e |
| Tpl-div-k | 61.86 | Not recorded | 68fa74281e209131cea6014e |
| T-div-k | 61.51 | Not recorded | 68fa74281e209131cea6014e |
| Tpl-top-k | 61.18 | Not recorded | 68fa74281e209131cea6014e |
| T-rand-k | 60.97 | Not recorded | 68fa74281e209131cea6014e |
| T-rand-k | 59.49 | Not recorded | 68fa74281e209131cea6014e |
| SRC | 58.54 | Not recorded | 68fa74281e209131cea6014e |
| GEN | 56.23 | Not recorded | 68fa74281e209131cea6014e |
| GEN | 56.17 | Not recorded | 68fa74281e209131cea6014e |
| SRC | 55.45 | Not recorded | 68fa74281e209131cea6014e |

### Tpl-div-k

Accuracy: 65.34. Result ID: 69933f7c3a6c31484914afa8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Implementation](<https://github.com/LLM-Based-Augmentations>)

Recorded evaluation configuration: {"Evaluation protocol":"translate-train","Supervision type":"hard prompt labels","Data selection strategy":"div-k"}. This record does not assert independent reproduction.

### SRC+GEN

Accuracy: 64.3. Result ID: 69933f7c3a6c31484914afa2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

Recorded evaluation configuration: {"Evaluation protocol":"translate-train"}. This record does not assert independent reproduction.

### Tpl-rand-k

Accuracy: 64.11. Result ID: 69933f7c3a6c31484914afa7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Implementation](<https://github.com/LLM-Based-Augmentations>)

Recorded evaluation configuration: {"Evaluation protocol":"translate-train","Supervision type":"hard prompt labels","Data selection strategy":"rand-k"}. This record does not assert independent reproduction.

### T-div-k

Accuracy: 64.1. Result ID: 69933f7c3a6c31484914afa5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Implementation](<https://github.com/LLM-Based-Augmentations>)

Recorded evaluation configuration: {"Evaluation protocol":"translate-train","Supervision type":"teacher soft pseudolabels","Data selection strategy":"div-k"}. This record does not assert independent reproduction.

### Tpl-top-k

Accuracy: 63.78. Result ID: 69933f7c3a6c31484914afa6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Implementation](<https://github.com/LLM-Based-Augmentations>)

Recorded evaluation configuration: {"Evaluation protocol":"translate-train","Supervision type":"hard prompt labels","Data selection strategy":"top-k"}. This record does not assert independent reproduction.

### SRC+GEN

Accuracy: 63.64. Result ID: 69933f7c3a6c31484914af48.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction.

### T-top-k

Accuracy: 62.94. Result ID: 69933f7c3a6c31484914af49.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Implementation](<https://github.com/LLM-Based-Augmentations>)

Recorded evaluation configuration: {"selection strategy":"top-k","Zero-shot":"true"}. This record does not assert independent reproduction.

### T-top-k

Accuracy: 62.9. Result ID: 69933f7c3a6c31484914afa3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Implementation](<https://github.com/LLM-Based-Augmentations>)

Recorded evaluation configuration: {"Evaluation protocol":"translate-train","Supervision type":"teacher soft pseudolabels","Data selection strategy":"top-k"}. This record does not assert independent reproduction.

### Tpl-rand-k

Accuracy: 62.49. Result ID: 69933f7c3a6c31484914af4d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Implementation](<https://github.com/LLM-Based-Augmentations>)

Recorded evaluation configuration: {"selection strategy":"rand-k","Zero-shot":"true"}. This record does not assert independent reproduction.

### Tpl-div-k

Accuracy: 61.86. Result ID: 69933f7c3a6c31484914af4e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Implementation](<https://github.com/LLM-Based-Augmentations>)

Recorded evaluation configuration: {"selection strategy":"div-k","Zero-shot":"true"}. This record does not assert independent reproduction.

### T-div-k

Accuracy: 61.51. Result ID: 69933f7c3a6c31484914af4b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Implementation](<https://github.com/LLM-Based-Augmentations>)

Recorded evaluation configuration: {"selection strategy":"div-k","Zero-shot":"true"}. This record does not assert independent reproduction.

### Tpl-top-k

Accuracy: 61.18. Result ID: 69933f7c3a6c31484914af4c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Implementation](<https://github.com/LLM-Based-Augmentations>)

Recorded evaluation configuration: {"selection strategy":"top-k","Zero-shot":"true"}. This record does not assert independent reproduction.

### T-rand-k

Accuracy: 60.97. Result ID: 69933f7c3a6c31484914afa4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Implementation](<https://github.com/LLM-Based-Augmentations>)

Recorded evaluation configuration: {"Evaluation protocol":"translate-train","Supervision type":"teacher soft pseudolabels","Data selection strategy":"rand-k"}. This record does not assert independent reproduction.

### T-rand-k

Accuracy: 59.49. Result ID: 69933f7c3a6c31484914af4a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

[Implementation](<https://github.com/LLM-Based-Augmentations>)

Recorded evaluation configuration: {"selection strategy":"rand-k","Zero-shot":"true"}. This record does not assert independent reproduction.

### SRC

Accuracy: 58.54. Result ID: 69933f7c3a6c31484914afa1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

Recorded evaluation configuration: {"Evaluation protocol":"translate-train"}. This record does not assert independent reproduction.

### GEN

Accuracy: 56.23. Result ID: 69933f7c3a6c31484914afa0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

Recorded evaluation configuration: {"Evaluation protocol":"translate-train"}. This record does not assert independent reproduction.

### GEN

Accuracy: 56.17. Result ID: 69933f7c3a6c31484914af46.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction.

### SRC

Accuracy: 55.45. Result ID: 69933f7c3a6c31484914af47.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74281e209131cea6014e.md>)

Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.