Multilingual Commonsense Reasoning on X-CSQA
45.5Accuracy (SW)MINDMERGER-SOFT
Evaluation Results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| MINDMERGER-SOFTYear=20242025.10 | 45.5 | 46.2 | 48.4 | 51.4 | 60.6 | 53.9 | 63.3 | 62.9 | 63.8 | 66.8 | 67 | 67.1 | 68.1 | 69.1 | 75.2 | 78.1 | 61 | |
| WITH LIRA-LARGEYear=OURS2025.10 | 40.8 | 52.7 | 55.6 | 63.9 | 65 | 61.3 | 64.2 | 68.3 | 67.9 | 66.3 | 69.7 | 70.8 | 72 | 70.7 | 74.6 | 84.2 | 65.5 | |
| TRANSLATE-ENYear=20232025.10 | 36.5 | 41.3 | 48.4 | 44.6 | 51.8 | 47.1 | 53.3 | 51.5 | 55 | 56.3 | 57.3 | 54.7 | 57.2 | 55.5 | 71.3 | 71.3 | 52.3 | |
| QWEN3-8BYear=20252025.10 | 35.7 | 51.6 | 52.8 | 60.9 | 63 | 59.3 | 62.5 | 66.6 | 64.7 | 64.1 | 67.6 | 66.9 | 68.2 | 69.8 | 70.1 | 82.8 | 62.9 | |
| QALIGNYear=20242025.10 | 35.1 | 32.6 | 37.8 | 36.3 | 50.5 | 49.2 | 57.1 | 54.8 | 56.3 | 58.3 | 58.3 | 58.8 | 59.8 | 60.3 | 63.1 | 75.7 | 52.3 | |
| MINDMERGER-HARDYear=20242025.10 | 33.1 | 29.9 | 40.4 | 37.7 | 52.9 | 49.9 | 54.7 | 55.4 | 58 | 59.7 | 58.6 | 61.9 | 62.5 | 63.6 | 75.2 | 75.2 | 53.1 | |
| LANGBRIDGEYear=20242025.10 | 31.8 | 30.5 | 30.6 | 30.6 | 33.3 | 33.9 | 39.8 | 39.8 | 38.4 | 39.1 | 37.4 | 36.4 | 33.8 | 38.2 | 38.8 | 44.4 | 36.1 | |
| MULTIREASON-SFTYear=20242025.10 | 27.6 | 29.2 | 32 | 28.7 | 38.8 | 38.7 | 45.5 | 43.8 | 45.9 | 46.5 | 50.2 | 49.1 | 51.2 | 52.1 | 54.3 | 67.2 | 43.8 | |
| MULTIREASON-LORAYear=20222025.10 | 25.1 | 32 | 39.2 | 42.2 | 56.6 | 55.9 | 60.6 | 62.2 | 61.3 | 62.8 | 66.3 | 64.9 | 66.2 | 67.4 | 67.7 | 79.3 | 56.9 | |
| MONOREASONYear=20242025.10 | 24.2 | 25.1 | 32.9 | 32.3 | 50.9 | 49.1 | 50.6 | 56.5 | 57.5 | 56 | 56 | 61.2 | 61.7 | 63.5 | 64 | 76.3 | 51.3 |