Video-grounded understanding and actionable reasoning on Pause-and-think-B 1.0 (test)
64.24Overall ScoreGPT-5.2
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-5.2Model Category=Frontier Models (Closed), Thinking Formulation=NT2026.05 | 64.24 | 55.13 | 86.52 | |
| GPT-5.0Model Category=Frontier Models (Closed), Thinking Formulation=NT2026.05 | 59.27 | 52.63 | 74.19 | |
| Qwen-3VL-235B-InstructModel Category=Frontier Models (Open), Thinking Formulation=NT2026.05 | 58.89 | 53.03 | 72.26 | |
| Qwen-3VL-4B-Instruct (Ours)Model Category=Finetuned Models, Finetuning Protocol=Frozen ViT and projector, Thinking Formulation=T2026.05 | 58 | 55.02 | 64.84 | |
| Qwen-3VL-4B-InstructModel Category=Finetuned Models, Finetuning Protocol=Full, Thinking Formulation=T2026.05 | 56.33 | 51.67 | 67.03 | |
| Gemini-2.5-proModel Category=Frontier Models (Closed), Thinking Formulation=NT2026.05 | 55.39 | 49.05 | 69.85 | |
| Qwen-3VL-4B-Instruct (Ours)Model Category=Finetuned Models, Finetuning Protocol=Frozen ViT and projector, Thinking Formulation=NT2026.05 | 54.67 | 55.77 | 52.17 | |
| Gemini-robotics-ER-1.5-previewModel Category=Frontier Models (Closed), Thinking Formulation=NT2026.05 | 53.17 | 45.24 | 71.68 | |
| Qwen-3VL-2B-InstructModel Category=Finetuned Models, Finetuning Protocol=Frozen ViT and projector, Thinking Formulation=T2026.05 | 52.67 | 52.38 | 53.33 | |
| Qwen-3VL-4B-ThinkingModel Category=Finetuned Models, Finetuning Protocol=Frozen ViT and projector, Thinking Formulation=NT2026.05 | 52.33 | 50.95 | 55.56 | |
| Qwen-3VL-4B-ThinkingModel Category=Finetuned Models, Finetuning Protocol=Full, Thinking Formulation=NT2026.05 | 52 | 50.48 | 55.56 | |
| Qwen-3VL-2B-InstructModel Category=Finetuned Models, Finetuning Protocol=Frozen ViT and projector, Thinking Formulation=NT2026.05 | 51.33 | 50 | 54.44 | |
| InternVL3_5-241BModel Category=Additional Models, Thinking Formulation=NT2026.05 | 50.67 | 43.81 | 66.67 | |
| GPT-4oModel Category=Frontier Models (Closed), Thinking Formulation=NT2026.05 | 50.33 | 42.58 | 68.13 | |
| Qwen-3VL-4B-InstructModel Category=Base Models, Thinking Formulation=NT2026.05 | 49 | 46.86 | 53.76 | |
| Qwen-3VL-2B-InstructModel Category=Base Models, Thinking Formulation=NT2026.05 | 45.67 | 46.19 | 44.44 | |
| Qwen-3VL-2B-ThinkingModel Category=Finetuned Models, Finetuning Protocol=Frozen ViT and projector, Thinking Formulation=NT2026.05 | 44.67 | 48.1 | 36.67 | |
| Kimi-VL-A3B-InstructModel Category=Additional Models, Thinking Formulation=NT2026.05 | 39.33 | 36.36 | 46.15 | |
| Qwen-2.5VL-3B-InstructModel Category=Finetuned Models, Finetuning Protocol=Frozen ViT and projector, Thinking Formulation=NT2026.05 | 36.11 | 31.84 | 46.58 | |
| Qwen-2.5VL-3B-InstructModel Category=Base Models, Thinking Formulation=NT2026.05 | 24.6 | 18.99 | 38.36 |