Commonsense Knowledge on MMLU-Pro
48.4AccuracyYoutu-LLM
Evaluation results
| Method | Links | |
|---|---|---|
| Youtu-LLMSize=2B, Type=Base, Prompt Setting=5-shot2025.12 | 48.4 | |
| Qwen3Size=4B, Type=Base, Prompt Setting=5-shot2025.12 | 46.1 | |
| Llama3.1Size=8B, Type=Base, Prompt Setting=5-shot2025.12 | 36.2 | |
| SmolLM3Size=3B, Type=Base, Prompt Setting=5-shot2025.12 | 35.3 | |
| Qwen3Size=1.7B, Type=Base, Prompt Setting=5-shot2025.12 | 34.9 | |
| Gemma3Size=4B, Type=Base, Prompt Setting=5-shot2025.12 | 29.4 |