Video Reasoning on Seed-Bench R1
50.5Average Answer ScoreAPPO
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| APPOBackbone=Qwen2.5-VL-7B, Resolution=224x224, Sampling Rate=1 fps, Max Frames=602026.02 | 50.5 | — | — | — | |
| DAPOBackbone=Qwen2.5-VL-7B, Resolution=224x224, Sampling Rate=1 fps, Max Frames=602026.02 | 50 | — | — | — | |
| GRPOBackbone=Qwen2.5-VL-7B, Resolution=224x224, Sampling Rate=1 fps, Max Frames=602026.02 | 48.9 | — | — | — | |
| SFTBackbone=Qwen2.5-VL-7B, Resolution=224x224, Sampling Rate=1 fps, Max Frames=602026.02 | 42.3 | — | — | — | |
| APPOBackbone=Qwen2.5-VL-3B, Resolution=224x224, Sampling Rate=1 fps, Max Frames=602026.02 | 37.2 | — | — | — | |
| APPOSize=7B, Training Data=34K, Resolution=224 x 224, Sampling Rate (fps)=1fps, Maximum Frames=30, Zero-shot evaluation=true2026.02 | 36.1 | — | — | — | |
| DAPOBackbone=Qwen2.5-VL-3B, Resolution=224x224, Sampling Rate=1 fps, Max Frames=602026.02 | 35.3 | — | — | — | |
| GRPOBackbone=Qwen2.5-VL-3B, Resolution=224x224, Sampling Rate=1 fps, Max Frames=602026.02 | 34 | — | — | — | |
| VideoChat-R1Size=7B, Training Data=18K, Resolution=224 x 224, Sampling Rate (fps)=1fps, Maximum Frames=30, Zero-shot evaluation=true2026.02 | 31.8 | — | — | — | |
| SFTBackbone=Qwen2.5-VL-3B, Resolution=224x224, Sampling Rate=1 fps, Max Frames=602026.02 | 31.6 | — | — | — | |
| VideoRFTSize=7B, Training Data=310K, Resolution=224 x 224, Sampling Rate (fps)=1fps, Maximum Frames=30, Zero-shot evaluation=true2026.02 | 30.9 | — | — | — | |
| Video-R1Size=7B, Training Data=260K, Resolution=224 x 224, Sampling Rate (fps)=1fps, Maximum Frames=30, Zero-shot evaluation=true2026.02 | 30.7 | — | — | — | |
| Base ModelBackbone=Qwen2.5-VL-7B, Resolution=224x224, Sampling Rate=1 fps, Max Frames=602026.02 | 30.5 | — | — | — | |
| TW-GRPOSize=7B, Training Data=1K, Resolution=224 x 224, Sampling Rate (fps)=1fps, Maximum Frames=30, Zero-shot evaluation=true2026.02 | 28.3 | — | — | — | |
| GRPO-CARESize=7B, Training Data=260K, Resolution=224 x 224, Sampling Rate (fps)=1fps, Maximum Frames=30, Zero-shot evaluation=true2026.02 | 28.1 | — | — | — | |
| Base ModelBackbone=Qwen2.5-VL-3B, Resolution=224x224, Sampling Rate=1 fps, Max Frames=602026.02 | 28 | — | — | — | |
| Qwen3VLSize=8B2026.02 | 1.87 | 1.95 | 1.94 | 1.65 | |
| TwiFFSize=7B2026.02 | 1.62 | 1.64 | 1.67 | 1.56 | |
| InternVL3.5Size=8B2026.02 | 1.55 | 1.58 | 1.67 | 1.39 | |
| TwiFF-LiteSize=7B2026.02 | 1.55 | 1.56 | 1.62 | 1.5 | |
| DeepEyesSize=7B2026.02 | 1.5 | 1.57 | 1.64 | 1.28 | |
| Qwen2.5VLSize=7B2026.02 | 1.45 | 1.49 | 1.6 | 1.29 | |
| BagelSize=7B2026.02 | 1.34 | 1.36 | 1.48 | 1.22 | |
| Janus-ProSize=7B2026.02 | 1.15 | 1.25 | 1.29 | 0.98 | |
| Zebra-COTSize=7B2026.02 | 1.11 | 1.09 | 1.19 | 1.11 | |
| ThinkMorphSize=7B2026.02 | 1.07 | 1.07 | 1.13 | 1.03 |