Instruction Following on MultiChallenge
69.3ScoreGemini-3-Flash
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemini-3-FlashTier=High2026.06 | 69.3 | — | |
| Gemini-3-pro High2026.06 | 68.7 | — | |
| Seed2.0 Pro2026.06 | 68.3 | — | |
| ERNIE 5.02026.02 | 65.98 | — | |
| DS-v4-ProParameter Count=1.6T-A49B2026.06 | 64.1 | — | |
| Qwen-3.5Parameter Count=397B-17B2026.06 | 63.9 | — | |
| Nemotron 3 UltraParameter Count=550B-A55B2026.06 | 63.8 | — | |
| DS-v4-FlashParameter Count=284B-A13B2026.06 | 63.5 | — | |
| Seed2.0 Lite2026.06 | 63.2 | — | |
| Kimi-K2.6Parameter Count=1T-A32B2026.06 | 63.1 | — | |
| GLM-5.1Parameter Count=744B-A40B2026.06 | 63 | — | |
| STEP3-VL-10BNumber of Parameters=10B2026.01 | 62.64 | — | |
| Gemini 3-Pro2026.02 | 62.5 | — | |
| Seed2.0 Mini2026.06 | 61.1 | — | |
| GPT-5.2 High2026.06 | 59.5 | — | |
| GPT-5-miniTier=High2026.06 | 59 | — | |
| Claude-Opus-4.52026.06 | 59 | — | |
| GPT-5 (High)2026.02 | 58.3 | — | |
| Claude-Sonnet-4.52026.06 | 57.3 | — | |
| Gemini 2.5-Pro2026.02 | 51.5 | — | |
| Qwen3-VL ThinkingNumber of Parameters=8B2026.01 | 49.82 | — | |
| MiMo-VL RL-2508Number of Parameters=7B2026.01 | 44.69 | — | |
| MiniMax-2.7Parameter Count=230B-A10B2026.06 | 42.5 | — | |
| GLM-4.6V FlashNumber of Parameters=9B2026.01 | 42.49 | — | |
| DS V3.2-Thinking2026.02 | 42.43 | — | |
| InternVL 3.5Number of Parameters=8B2026.01 | 37.73 | — | |
| AutoIF-RLVR2026.06 | — | 45.4 | |
| QUBRIC2026.06 | — | 44.5 | |
| RM-RLHFlength_penalty=none2026.06 | — | 45.7 | |
| RM-RLHFlength_penalty=1.02026.06 | — | 41.8 | |
| Rubric-RLquery=Original Query2026.06 | — | 44.5 | |
| SFT Baseline2026.06 | — | 40.2 |