Intent Classification on IntentGrasp All Set
48.73Accuracy (No Shuffle)Gemma4 31B
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Gemma4 31BModel Family=Gemma4, Parameters=31B2026.05 | 48.73 | 49.88 | 49.45 | 49.35 | 49.35 | 0.48 | |
| Gemma4 E4BModel Family=Gemma4, Parameters=E4B2026.05 | 45.13 | 46.01 | 46.13 | 46.2 | 45.87 | 0.5 | |
| Qwen3 32BModel Family=Qwen3, Parameters=32B2026.05 | 43.4 | 44.27 | 44.62 | 44.61 | 44.22 | 0.57 | |
| Llama3 70BModel Family=Llama3, Parameters=70B2026.05 | 42.69 | 44.08 | 44.36 | 44.55 | 43.92 | 0.84 | |
| Olmo3 32BModel Family=Olmo3, Parameters=32B2026.05 | 41.82 | 43.33 | 44.26 | 43.95 | 43.34 | 1.09 | |
| Gemma4 E2BModel Family=Gemma4, Parameters=E2B2026.05 | 39.81 | 40.45 | 40.96 | 40.86 | 40.52 | 0.52 | |
| Qwen3 4BModel Family=Qwen3, Parameters=4B2026.05 | 36.5 | 38.42 | 39.13 | 38.52 | 38.14 | 1.14 | |
| Olmo3 7BModel Family=Olmo3, Parameters=7B2026.05 | 31.67 | 33.07 | 32.82 | 32.72 | 32.57 | 0.62 | |
| Qwen3 8BModel Family=Qwen3, Parameters=8B2026.05 | 30.18 | 40.04 | 40.8 | 39.91 | 37.73 | 5.05 | |
| Llama3 3BModel Family=Llama3, Parameters=3B2026.05 | 26.01 | 27.47 | 27.71 | 27.28 | 27.12 | 0.76 | |
| Llama3 8BModel Family=Llama3, Parameters=8B2026.05 | 20.23 | 31.06 | 31.2 | 30.94 | 28.36 | 5.42 |