List your company
ResearchFormerly WizWand

Multitask Language Understanding on MMMLU (24 official EU languages)

80.6Overall ScoreQwen-3-30B-A3B
48.04856.49964.9573.401Feb 5, 2026
Updated 8mo ago

Evaluation results

MethodLinks
Qwen-3-30B-A3BWeights accessibility=Open-weights, Regional origin=Non-European2026.0280.6
Llama-3.3-70BWeights accessibility=Open-weights, Regional origin=Non-European2026.0279.9
Qwen-3-32BWeights accessibility=Open-weights, Regional origin=Non-European2026.0279.9
Mistral-3.2-24BWeights accessibility=Open-weights, Regional origin=European2026.0276
Gemma-3-27BWeights accessibility=Open-weights, Regional origin=Non-European2026.0275.8
Qwen-3-14BWeights accessibility=Open-weights, Regional origin=Non-European2026.0275.8
Gemma-3-12BWeights accessibility=Open-weights, Regional origin=Non-European2026.0270.3
OLMo-3.1-32BWeights accessibility=Fully-open, Regional origin=Non-European2026.0268.2
EuroLLM-22BWeights accessibility=Fully-open, Regional origin=European2026.0265.6
Apertus-70BWeights accessibility=Fully-open, Regional origin=European2026.0261.7
EuroLLM-9BWeights accessibility=Fully-open, Regional origin=European2026.0261.5
Llama-3.1-8BWeights accessibility=Open-weights, Regional origin=Non-European2026.0254.3
Apertus-8BWeights accessibility=Fully-open, Regional origin=European2026.0254
OLMo-3-7BWeights accessibility=Fully-open, Regional origin=Non-European2026.0249.3