Tool Use on SimpleQA
91.5AccuracyQwen 3 VL 32B Instruct
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen 3 VL 32B InstructParameters=32B2025.12 | 91.5 | |
| Qwen 3 VL 8B Inststage=Instruct2025.12 | 90.3 | |
| Qwen 2.5 32BParameters=32B2025.12 | 90 | |
| Qwen 3 32BThinking=No, Parameters=32B2025.12 | 86.7 | |
| Olmo 3.1 32B InstructStage=DPO2025.12 | 85.3 | |
| Olmo 3.1 32B InstructStage=Final Instruct 3.12025.12 | 84.7 | |
| Olmo 3.1 32B InstructStage=SFT2025.12 | 82.3 | |
| Olmo 3 7B Instructstage=DPO2025.12 | 79.8 | |
| Olmo 3 7B Instructstage=Final Instruct2025.12 | 79.3 | |
| Qwen 3 8Bstage=Instruct2025.12 | 79 | |
| Qwen 2.5 7Bstage=Instruct2025.12 | 78 | |
| Olmo 3 7B Instructstage=SFT2025.12 | 74.2 |