Instruction Following on IFBench (Accuracy %)
76.5AccuracyQwen3.5-397B-A17B
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen3.5-397B-A17BParams=397B2026.06 | 76.5 | |
| GLM-5Params=744B2026.06 | 76.5 | |
| MiniMax M2.7Params=229B2026.06 | 76 | |
| Gemma 4 31BModel size=31B, Thinking mode=true2026.07 | 76 | |
| VibeThinker-3BParams=3B2026.06 | 74.5 | |
| VibeThinker-3BParams=3B2026.06 | 74.5 | |
| Qwen3.6 PlusParams=N/A2026.06 | 74.2 | |
| Gemma 4 12BModel size=12B, Thinking mode=true2026.07 | 74 | |
| GPT-5 (high)Params=N/A2026.06 | 73.1 | |
| Gemma 4 26B-A4BModel size=26B-A4B, Thinking mode=true2026.07 | 72 | |
| Nemotron-3-NanoParams=30B2026.06 | 71.5 | |
| Gemini 3 ProParams=N/A2026.06 | 70.4 | |
| Kimi K2.5Params=1T2026.06 | 70 | |
| GPT-OSS (high)Params=120B2026.06 | 69.5 | |
| OpenAI o3 (high)Params=N/A2026.06 | 69.3 | |
| TeacherModel=MiMo-V2-Flash, Status=RL-trained2026.06 | 68.9 | |
| MOPDModel=MiMo-V2-Flash2026.06 | 66.7 | |
| GPT-OSS-20B (high)Params=20B2026.06 | 65 | |
| MiMo v2 FlashParams=309B2026.06 | 64.2 | |
| DeepSeek V3.2Params=671B2026.06 | 60.7 | |
| Qwen3.5-4BParams=4B2026.06 | 59.2 | |
| Claude Opus 4.5Params=N/A2026.06 | 58 | |
| StudentModel=MiMo-V2-Flash2026.06 | 55.4 | |
| Grok 4Params=N/A2026.06 | 53.7 | |
| Qwen3-4B-Thinking-2507Params=4B2026.06 | 52.9 | |
| Phi4-Reasoning-PlusParams=14B2026.06 | 51.7 | |
| Qwen3-235B-A22B-ThinkingParams=235B2026.06 | 51.2 | |
| Gemini 2.5 ProParams=N/A2026.06 | 48.7 | |
| Gemma-4-itParams=12B2026.06 | 45.2 | |
| Gemma 4 E4BModel size=E4B, Thinking mode=true2026.07 | 44 | |
| DeepSeek R1 0528Params=671B2026.06 | 39.6 | |
| Gemma 4 E2BModel size=E2B, Thinking mode=true2026.07 | 38 | |
| GLM-4.5-AirParams=106B2026.06 | 37.6 | |
| Gemini 2.5 FlashParams=N/A2026.06 | 36.1 | |
| Ministral-3-Reasoning-2512Params=14B2026.06 | 32.3 | |
| Gemma 3 27BModel size=27B, Thinking mode=false2026.07 | 32 | |
| Mimo7B-RL-0530Params=7B2026.06 | 31.6 | |
| OpenReasoning-NemotronParams=7B2026.06 | 31.3 | |
| Olmo-3-ThinkParams=7B2026.06 | 30 | |
| SmolLM3Params=3B2026.06 | 27.6 | |
| Hunyuan-4B-InstructParams=4B2026.06 | 26.5 |