List your company

Multitask Language Understanding on MMLU-ProX non-EU languages (test)

70.9AccuracyQwen-3-30B-A3B
26.1837.7949.461.01Feb 5, 2026

Evaluation results

MethodLinks
Qwen-3-30B-A3BRelease Type=Open-weights, Model Category=Non-European2026.0270.9
Qwen-3-32BRelease Type=Open-weights, Model Category=Non-European2026.0269
Qwen-3-14BRelease Type=Open-weights, Model Category=Non-European2026.0264.6
Llama-3.3-70BRelease Type=Open-weights, Model Category=Non-European2026.0263.4
Mistral-3.2-24BRelease Type=Open-weights, Model Category=European2026.0262.5
Gemma-3-27BRelease Type=Open-weights, Model Category=Non-European2026.0258.8
OLMo-3.1-32BRelease Type=Fully-open, Model Category=Non-European2026.0255.1
Gemma-3-12BRelease Type=Open-weights, Model Category=Non-European2026.0251.8
EuroLLM-22B (new)Release Type=Fully-open, Model Category=European2026.0243.8
OLMo-3-7BRelease Type=Fully-open, Model Category=Non-European2026.0240.5
EuroLLM-9B (new)Release Type=Fully-open, Model Category=European2026.0236.5
EuroLLM-22B (old)Release Type=Fully-open, Model Category=European2026.0236.4
Apertus-70BRelease Type=Fully-open, Model Category=European2026.0235.2
Llama-3.1-8BRelease Type=Open-weights, Model Category=Non-European2026.0231.1
Apertus-8BRelease Type=Fully-open, Model Category=European2026.0228.6
EuroLLM-9B (old)Release Type=Fully-open, Model Category=European2026.0227.9