List your company
ResearchFormerly WizWand

Natural Language Understanding on EuroEval German

0.1EuroEval Scoreaya-3B (Monolingual Paired DPO)
-1.79210.97923.7536.521May 25, 2026
Updated 5mo ago

Evaluation results

MethodLinks
aya-3B (Monolingual Paired DPO)Language model=aya-3B, Regime=Monolingual, Post-training=DPO, Data Selection=Paired2026.050.1
aya-3B (Multilingual Paired DPO)Language model=aya-3B, Regime=Multilingual, Post-training=DPO, Data Selection=Paired2026.050.1
EuroLLM-9B (Monolingual In-lang SFT)Language model=EuroLLM-9B, Regime=Monolingual, Post-training=SFT, Data Selection=In-lang2026.050.4
MAPO (13B)Baseline Model=MAPO, Parameters=13B, Comparison=aya-3B2026.050.7
EuroLLM-9B (Multilingual Max-R SFT)Language model=EuroLLM-9B, Regime=Multilingual, Post-training=SFT, Data Selection=Max-R2026.050.9
EuroLLM-9B (Monolingual Paired DPO)Language model=EuroLLM-9B, Regime=Monolingual, Post-training=DPO, Data Selection=Paired2026.051
EuroLLM-9B (Multilingual Paired DPO)Language model=EuroLLM-9B, Regime=Multilingual, Post-training=DPO, Data Selection=Paired2026.051.2
ICR (8B)Baseline Model=ICR, Parameters=8B, Comparison=aya-3B2026.051.7
EuroLLM-9B (Monolingual Max-R SFT)Language model=EuroLLM-9B, Regime=Monolingual, Post-training=SFT, Data Selection=Max-R2026.052
EuroLLM-9B (Multilingual All Lang SFT)Language model=EuroLLM-9B, Regime=Multilingual, Post-training=SFT, Data Selection=All Lang2026.053.8
aya-3B (Monolingual In-lang SFT)Language model=aya-3B, Regime=Monolingual, Post-training=SFT, Data Selection=In-lang2026.054.2
aya-3B (Monolingual Max-R SFT)Language model=aya-3B, Regime=Monolingual, Post-training=SFT, Data Selection=Max-R2026.055.7
MAPO (13B)Baseline Model=MAPO, Parameters=13B, Comparison=EuroLLM-9B2026.055.7
ICR (8B)Baseline Model=ICR, Parameters=8B, Comparison=EuroLLM-9B2026.056.7
aya-3B (Multilingual All Lang SFT)Language model=aya-3B, Regime=Multilingual, Post-training=SFT, Data Selection=All Lang2026.056.9
aya-3B (Multilingual Max-R SFT)Language model=aya-3B, Regime=Multilingual, Post-training=SFT, Data Selection=Max-R2026.057.6
aya-3B (Base)Language model=aya-3B, Regime=Baseline2026.0542.4
EuroLLM-9B (Base)Language model=EuroLLM-9B, Regime=Baseline2026.0547.4