Short Question Answering on BLEnD Short Question Answer
41.5Average AccuracyGemma3-4B
Evaluation results
| Method | Links | |||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Gemma3-4BPrompting=English-Only2026.03 | 41.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Tiny Aya FirePrompting=English-Only2026.03 | 41 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3.5-4BPrompting=English-Only2026.03 | 40.85 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-4BPrompting=English-Only2026.03 | 40.75 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Tiny Aya EarthPrompting=English-Only2026.03 | 40.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Tiny Aya WaterPrompting=English-Only2026.03 | 39.57 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Tiny Aya GlobalPrompting=English-Only2026.03 | 38.59 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SmolLM3-3BPrompting=English-Only2026.03 | 38.28 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3.5-4BPrompt Language=Source-Language2026.03 | 36.74 | 28.54 | 60.42 | 5.39 | 45.08 | 61.87 | 66.8 | 34.69 | 23.86 | 35.74 | 14.84 | 45.73 | 60.53 | 32.79 | 12.02 | 24.9 | 34.58 | — | — | — | — | — | — | |
| Ministral-3-3BPrompting=English-Only2026.03 | 34.71 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Gemma3-4BPrompt Language=Source-Language2026.03 | 33.6 | 27.73 | 7.92 | 3.66 | 52.04 | 64.04 | 50.4 | 42.63 | 28.57 | 42.98 | 11.4 | 44.51 | 59.84 | 37.01 | 12.63 | 20 | 32.3 | — | — | — | — | — | — | |
| Tiny Aya FirePrompt Language=Source-Language2026.03 | 33.31 | 24.4 | 11.46 | 11.45 | 42.13 | 62.2 | 51.21 | 39.07 | 24.51 | 37.19 | 18.32 | 47.46 | 59.1 | 11.36 | 7.74 | 20.65 | 31.88 | — | — | — | — | — | — | |
| Tiny Aya WaterPrompt Language=Source-Language2026.03 | 32.39 | 38.34 | 12.08 | 11.21 | 41.02 | 64.5 | 50.3 | 36.64 | 26.25 | 36.78 | 16.38 | 43 | 57.99 | 40.04 | 7.54 | 18.61 | 31.54 | — | — | — | — | — | — | |
| Tiny Aya GlobalPrompt Language=Source-Language2026.03 | 32.33 | 24.89 | 11.67 | 11.21 | 40.7 | 64.24 | 49.9 | 33.94 | 25.22 | 37.68 | 15.91 | 42.39 | 57.06 | 40.95 | 8.76 | 18.57 | 32.3 | — | — | — | — | — | — | |
| Tiny Aya EarthPrompt Language=Source-Language2026.03 | 31.94 | 27.29 | 11.88 | 10.34 | 43.06 | 63.23 | 45.44 | 35.02 | 22.08 | 33.54 | 17.42 | 43.5 | 59.71 | 42.3 | 8.55 | 18.4 | 31.68 | — | — | — | — | — | — | |
| Qwen3-4BPrompt Language=Source-Language2026.03 | 29.54 | 15.9 | 5.21 | 1.29 | 44.9 | 62.83 | 59.31 | 36.64 | 22.99 | 31.68 | 14.19 | 39.15 | 59.51 | 20.74 | 13.65 | 17.55 | 22.36 | — | — | — | — | — | — | |
| Ministral-3-3BPrompt Language=Source-Language2026.03 | 28.28 | 15.03 | 0 | 1.29 | 42.13 | 66.97 | 50.3 | 29.7 | 16.02 | 27.69 | 6.02 | 45.93 | 63.39 | 25.36 | 6.92 | 15.31 | 12.22 | — | — | — | — | — | — | |
| SmolLM3-3BPrompt Language=Source-Language2026.03 | 27.47 | 23.53 | 0.21 | 1.94 | 44.49 | 65.66 | 44.94 | 31.58 | 30.3 | 38.84 | 8.82 | 47.87 | 57.58 | 24.8 | 3.67 | 5.31 | 9.96 | — | — | — | — | — | — |