STEM on HLE MC
17.4Pass@1Youtu-LLM
Evaluation Results
| Method | Links | |
|---|---|---|
| Youtu-LLMSize=2B, Type=Base, Prompt Setting=3-shot2025.12 | 17.4 | |
| Qwen3Size=4B, Type=Base, Prompt Setting=3-shot2025.12 | 15 | |
| Llama3.1Size=8B, Type=Base, Prompt Setting=3-shot2025.12 | 11.5 | |
| Qwen3Size=1.7B, Type=Base, Prompt Setting=3-shot2025.12 | 10.7 | |
| Gemma3Size=4B, Type=Base, Prompt Setting=3-shot2025.12 | 8 | |
| SmolLM3Size=3B, Type=Base, Prompt Setting=3-shot2025.12 | 3.1 |