# Multilingual Commonsense Reasoning on X-CSQA

Source: [Multilingual Commonsense Reasoning on X-CSQA](<https://www.sota2.com/research/sota/multilingual-commonsense-reasoning-on-x-csqa>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-19T10:32:17.117Z

Evaluation of model performance on multilingual commonsense reasoning tasks using the X-CSQA dataset, reporting accuracy across numerous languages.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Multilingual Commonsense Reasoning |
| Dataset (including any stated split) | X-CSQA |
| Metric | Accuracy (SW) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy (SW)](<https://www.sota2.com/research/sota/multilingual-commonsense-reasoning-on-x-csqa.md?metric=Accuracy%20(SW)>): Higher is better; unit: PERCENT.

- [Accuracy (UR)](<https://www.sota2.com/research/sota/multilingual-commonsense-reasoning-on-x-csqa.md?metric=Accuracy%20(UR)>): Higher is better; unit: PERCENT.

- [Accuracy (HI)](<https://www.sota2.com/research/sota/multilingual-commonsense-reasoning-on-x-csqa.md?metric=Accuracy%20(HI)>): Higher is better; unit: PERCENT.

- [Accuracy (AR)](<https://www.sota2.com/research/sota/multilingual-commonsense-reasoning-on-x-csqa.md?metric=Accuracy%20(AR)>): Higher is better; unit: PERCENT.

- [Accuracy (VI)](<https://www.sota2.com/research/sota/multilingual-commonsense-reasoning-on-x-csqa.md?metric=Accuracy%20(VI)>): Higher is better; unit: PERCENT.

- [Accuracy (JA)](<https://www.sota2.com/research/sota/multilingual-commonsense-reasoning-on-x-csqa.md?metric=Accuracy%20(JA)>): Higher is better; unit: PERCENT.

- [Accuracy (PL)](<https://www.sota2.com/research/sota/multilingual-commonsense-reasoning-on-x-csqa.md?metric=Accuracy%20(PL)>): Higher is better; unit: PERCENT.

- [Accuracy (ZH)](<https://www.sota2.com/research/sota/multilingual-commonsense-reasoning-on-x-csqa.md?metric=Accuracy%20(ZH)>): Higher is better; unit: PERCENT.

- [Accuracy (NL)](<https://www.sota2.com/research/sota/multilingual-commonsense-reasoning-on-x-csqa.md?metric=Accuracy%20(NL)>): Higher is better; unit: PERCENT.

- [Accuracy (RU)](<https://www.sota2.com/research/sota/multilingual-commonsense-reasoning-on-x-csqa.md?metric=Accuracy%20(RU)>): Higher is better; unit: PERCENT.

- [Accuracy (IT)](<https://www.sota2.com/research/sota/multilingual-commonsense-reasoning-on-x-csqa.md?metric=Accuracy%20(IT)>): Higher is better; unit: PERCENT.

- [Accuracy (DE)](<https://www.sota2.com/research/sota/multilingual-commonsense-reasoning-on-x-csqa.md?metric=Accuracy%20(DE)>): Higher is better; unit: PERCENT.

- [Accuracy (PT)](<https://www.sota2.com/research/sota/multilingual-commonsense-reasoning-on-x-csqa.md?metric=Accuracy%20(PT)>): Higher is better; unit: PERCENT.

- [Accuracy (FR)](<https://www.sota2.com/research/sota/multilingual-commonsense-reasoning-on-x-csqa.md?metric=Accuracy%20(FR)>): Higher is better; unit: PERCENT.

- [Accuracy (ES)](<https://www.sota2.com/research/sota/multilingual-commonsense-reasoning-on-x-csqa.md?metric=Accuracy%20(ES)>): Higher is better; unit: PERCENT.

- [Accuracy (EN)](<https://www.sota2.com/research/sota/multilingual-commonsense-reasoning-on-x-csqa.md?metric=Accuracy%20(EN)>): Higher is better; unit: PERCENT.

- [Average Accuracy](<https://www.sota2.com/research/sota/multilingual-commonsense-reasoning-on-x-csqa.md?metric=Average%20Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy (SW) | Result date | Report paper |
| --- | --- | --- | --- |
| MINDMERGER-SOFT | 45.5 | Not recorded | 68fa7c281e209131cea8cbd9 |
| WITH LIRA-LARGE | 40.8 | Not recorded | 68fa7c281e209131cea8cbd9 |
| TRANSLATE-EN | 36.5 | Not recorded | 68fa7c281e209131cea8cbd9 |
| QWEN3-8B | 35.7 | Not recorded | 68fa7c281e209131cea8cbd9 |
| QALIGN | 35.1 | Not recorded | 68fa7c281e209131cea8cbd9 |
| MINDMERGER-HARD | 33.1 | Not recorded | 68fa7c281e209131cea8cbd9 |
| LANGBRIDGE | 31.8 | Not recorded | 68fa7c281e209131cea8cbd9 |
| MULTIREASON-SFT | 27.6 | Not recorded | 68fa7c281e209131cea8cbd9 |
| MULTIREASON-LORA | 25.1 | Not recorded | 68fa7c281e209131cea8cbd9 |
| MONOREASON | 24.2 | Not recorded | 68fa7c281e209131cea8cbd9 |

### MINDMERGER-SOFT

Accuracy (SW): 45.5. Result ID: 6a0c3adefbc373592c02f808.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb4e.md>)

[Implementation](<https://github.com/CONE-MT/MindMerger>)

Recorded evaluation configuration: {"Year":"2024"}. This record does not assert independent reproduction.

### WITH LIRA-LARGE

Accuracy (SW): 40.8. Result ID: 6a0c3adefbc373592c02f80a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Year":"OURS"}. This record does not assert independent reproduction.

### TRANSLATE-EN

Accuracy (SW): 36.5. Result ID: 6a0c3adefbc373592c02f801.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Year":"2023"}. This record does not assert independent reproduction.

### QWEN3-8B

Accuracy (SW): 35.7. Result ID: 6a0c3adefbc373592c02f809.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Year":"2025"}. This record does not assert independent reproduction.

### QALIGN

Accuracy (SW): 35.1. Result ID: 6a0c3adefbc373592c02f805.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Year":"2024"}. This record does not assert independent reproduction.

### MINDMERGER-HARD

Accuracy (SW): 33.1. Result ID: 6a0c3adefbc373592c02f807.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa734f1e209131cea5bb4e.md>)

[Implementation](<https://github.com/CONE-MT/MindMerger>)

Recorded evaluation configuration: {"Year":"2024"}. This record does not assert independent reproduction.

### LANGBRIDGE

Accuracy (SW): 31.8. Result ID: 6a0c3adefbc373592c02f806.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73651e209131cea5c31f.md>)

Recorded evaluation configuration: {"Year":"2024"}. This record does not assert independent reproduction.

### MULTIREASON-SFT

Accuracy (SW): 27.6. Result ID: 6a0c3adefbc373592c02f803.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Year":"2024"}. This record does not assert independent reproduction.

### MULTIREASON-LORA

Accuracy (SW): 25.1. Result ID: 6a0c3adefbc373592c02f802.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Year":"2022"}. This record does not assert independent reproduction.

### MONOREASON

Accuracy (SW): 24.2. Result ID: 6a0c3adefbc373592c02f804.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c281e209131cea8cbd9.md>)

Recorded evaluation configuration: {"Year":"2024"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
