Cultural norm reasoning on NormAd Asia-Pacific 1.0 (test)
80.03AccuracyQwen3.5-4B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3.5-4BPrompt Language=Source-Language Stories2026.03 | 80.03 | |
| Tiny Aya EarthPrompt Language=Source-Language Stories2026.03 | 75.4 | |
| Ministral-3-3BPrompt Language=Source-Language Stories2026.03 | 74.04 | |
| Tiny Aya GlobalPrompt Language=Source-Language Stories2026.03 | 73.77 | |
| Qwen3-4BPrompt Language=Source-Language Stories2026.03 | 73.7 | |
| Gemma3-4BPrompt Language=Source-Language Stories2026.03 | 73.56 | |
| Tiny Aya WaterPrompt Language=Source-Language Stories2026.03 | 73.41 | |
| SmolLM3-3BPrompt Language=Source-Language Stories2026.03 | 73.11 | |
| Tiny Aya FirePrompt Language=Source-Language Stories2026.03 | 72.8 |