Cultural norm reasoning on NormAd Source-Language Stories
77.42Europe PerformanceMinistral-3-3B
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Ministral-3-3BNumber of Parameters=3B2026.03 | 77.42 | 53.32 | 57.03 | 74.04 | 60.36 | 77.72 | |
| Gemma3-4BNumber of Parameters=4B2026.03 | 75.37 | 63.11 | 67.77 | 73.56 | 65.46 | 70.25 | |
| Tiny Aya Fire2026.03 | 75.02 | 68.87 | 67.77 | 72.8 | 66.28 | 73.02 | |
| SmolLM3-3BNumber of Parameters=3B2026.03 | 74.4 | 68.83 | 64.97 | 73.11 | 61.52 | 73.65 | |
| Qwen3.5-4BNumber of Parameters=4B2026.03 | 72.7 | 69.53 | 77.8 | 80.03 | 68.82 | 73.37 | |
| Tiny Aya Global2026.03 | 72.27 | 67.44 | 69.07 | 73.77 | 64.7 | 68.64 | |
| Tiny Aya Earth2026.03 | 71.98 | 66.35 | 70.47 | 75.4 | 66.19 | 70.71 | |
| Tiny Aya Water2026.03 | 71.95 | 69.27 | 69.6 | 73.41 | 65.37 | 69.4 | |
| Qwen3-4BNumber of Parameters=4B2026.03 | 67.24 | 66.47 | 65.97 | 73.7 | 57.48 | 66.31 |