Multilingual Language Understanding on MMLU ProX-Lite
78.2Accuracy (en)Full translation
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Full translationModel=gpt-oss-20b2025.10 | 78.2 | 77.7 | 78.6 | 77.8 | 76 | 76.3 | 75.7 | 76.1 | 74.4 | 76.9 | 76.8 | 100 | |
| BaseModel=gpt-oss-20b2025.10 | 77.4 | 77.8 | 77.3 | 74.1 | 77.4 | 73.9 | 74.6 | 75.6 | 66.9 | 77 | 75.2 | 0 | |
| Selective translationModel=gpt-oss-20b2025.10 | 76.7 | 77 | 77.4 | 74.6 | 76 | 74.1 | 75 | 75.5 | 68.9 | 76.1 | 75.1 | 7.2 |