Video Understanding on 5 Video Benchmarks suite (MMVU, MVBench, VMME, VMMES, VMMMU)
74.2MMVU ScoreZPPO
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ZPPOBackbone=Qwen3.5-9B2026.06 | 74.2 | 71.7 | 70.2 | 72.8 | 82.1 | 74.2 | |
| Qwen3.5-9BBackbone=Qwen3.5-9B2026.06 | 73.8 | 71.4 | 70.5 | 72.4 | 80.9 | 73.8 | |
| GRPOBackbone=Qwen3.5-9B, Prompt Replay Buffer Augmentation=true2026.06 | 73.1 | 71.5 | 69.3 | 71.2 | 82 | 73.4 | |
| On-DistillBackbone=Qwen3.5-9B, Prompt Replay Buffer Augmentation=true2026.06 | 73 | 70.4 | 69.6 | 71.6 | 80.7 | 73.1 | |
| Off-DistillBackbone=Qwen3.5-9B, Prompt Replay Buffer Augmentation=true2026.06 | 72.5 | 69.6 | 68.5 | 71.5 | 80.8 | 72.6 | |
| ZPPOBackbone=Qwen3.5-4B2026.06 | 70.6 | 69.6 | 68.5 | 70.2 | 80.2 | 71.8 | |
| Qwen3.5-4BBackbone=Qwen3.5-4B2026.06 | 69.2 | 70.2 | 68.1 | 69.9 | 80.3 | 71.5 | |
| GRPOBackbone=Qwen3.5-4B, Prompt Replay Buffer Augmentation=true2026.06 | 69.2 | 69.1 | 68.2 | 68.7 | 79.4 | 70.9 | |
| On-DistillBackbone=Qwen3.5-4B, Prompt Replay Buffer Augmentation=true2026.06 | 68.7 | 67.8 | 67 | 69.3 | 78.9 | 70.3 | |
| Off-DistillBackbone=Qwen3.5-4B, Prompt Replay Buffer Augmentation=true2026.06 | 67.9 | 67.4 | 66.4 | 68.8 | 78.2 | 69.7 | |
| Qwen3.5 + ZPPOModel Size=2B2026.06 | 59 | 62.7 | 62.4 | 63.9 | 68.1 | 63.2 | |
| Qwen3.5 + GRPOModel Size=2B, Prompt Replay Buffer=true2026.06 | 56.7 | 61.7 | 61.2 | 62.6 | 67.3 | 61.9 | |
| Qwen3.5Model Size=2B2026.06 | 53.7 | 60.7 | 59.9 | 61.2 | 67.6 | 60.6 | |
| Qwen3.5 + On-DistillModel Size=2B, Prompt Replay Buffer=true2026.06 | 52.4 | 59.9 | 58.6 | 59.4 | 65.5 | 59.2 | |
| Qwen3.5 + Off-DistillModel Size=2B, Prompt Replay Buffer=true2026.06 | 51.5 | 59.2 | 57.9 | 59 | 65.4 | 58.6 | |
| Qwen3.5 + ZPPOModel Size=0.8B2026.06 | 42.5 | 56.6 | 53.9 | 54.9 | 56.4 | 52.8 | |
| Qwen3.5 + GRPOModel Size=0.8B, Prompt Replay Buffer=true2026.06 | 41.3 | 53.5 | 52.2 | 53 | 52.5 | 50.5 | |
| Qwen3.5Model Size=0.8B2026.06 | 39 | 51.6 | 50.3 | 51.6 | 48.8 | 48.3 | |
| Qwen3.5 + On-DistillModel Size=0.8B, Prompt Replay Buffer=true2026.06 | 36.8 | 49.2 | 47.8 | 49.6 | 45.7 | 45.8 | |
| Qwen3.5 + Off-DistillModel Size=0.8B, Prompt Replay Buffer=true2026.06 | 35.4 | 48.9 | 46.8 | 48.5 | 45.4 | 45 |