Video Reasoning on VBVR-Bench Out-of-Domain

61Average ScoreVBVR-Wan2.2

Evaluation Results

Method
VBVR-Wan2.22026.05	61	76.8	57.2	54.7	61.8	61.5
VideoRLVR2026.05	60.2	65.5	62	59.7	58.8	58.2
Wan2.2-I2V-A14B2026.05	32.9	40.5	30.8	34.3	23.6	30.7
CogVideoX1.52026.05	26.2	28.1	23.5	25	25.4	28.2
Human2026.03	0.988	1	1	0.99	1	0.97
VBVR-Wan2.2-5B-Distilled + VLM-as-Teacher2026.06	0.759	0.873	0.765	0.759	0.818	0.639
VBVR-Wan2.2 + CollabVR2026.05	0.696	0.884	0.634	0.641	0.608	0.72
VBVR-Wan2.2-5B + Pass@52026.06	0.661	0.725	0.664	0.665	0.695	0.564
VBVR-Wan2.2-5B + Pass@42026.06	0.66	0.723	0.661	0.665	0.695	0.563
VBVR-Wan2.2-5B-Distilled + Pass@52026.06	0.653	0.709	0.603	0.651	0.728	0.582
VBVR-Wan2.2-5B + Pass@32026.06	0.652	0.72	0.66	0.65	0.682	0.56
VBVR-Wan2.2-5B-Distilled + Pass@42026.06	0.652	0.703	0.603	0.651	0.727	0.581
VBVR-Wan2.2 + Training-Free Ensemble2026.03	0.65	0.803	0.705	0.531	0.639	0.716
VBVR-Wan2.2-5B + Pass@22026.06	0.65	0.718	0.659	0.647	0.68	0.559
VBVR-Wan2.2-5B-Distilled + Pass@32026.06	0.65	0.702	0.603	0.651	0.72	0.576
VBVR-Wan2.2-5B-Distilled + Pass@22026.06	0.647	0.701	0.603	0.651	0.707	0.575
VBVR-Wan2.2-5B-Distilled2026.06	0.64	0.688	0.603	0.651	0.693	0.565
VBVR-Wan2.2-5B2026.06	0.639	0.711	0.618	0.642	0.678	0.548
VBVR-Wan2.2-5B + VideoTPO2026.06	0.629	0.703	0.604	0.631	0.669	0.538
VBVR-Wan2.2 + Pass@42026.05	0.622	0.785	0.66	0.535	0.577	0.683
VBVR-Wan2.22026.03	0.61	0.768	0.572	0.547	0.618	0.615
VBVR-Wan2.2 + Pass@22026.05	0.602	0.728	0.617	0.494	0.532	0.701
VBVR-Wan2.2-14B2026.06	0.601	0.732	0.596	0.542	0.628	0.6
VBVR-Wan2.2-5B-Distilled + VideoTPO2026.06	0.597	0.652	0.584	0.613	0.641	0.495
VBVR-Wan2.2 + VideoTPO2026.05	0.582	0.767	0.619	0.513	0.54	0.572
VBVR-Wan2.22026.05	0.577	0.674	0.674	0.503	0.528	0.633
Sora 22026.03	0.523	0.546	0.472	0.525	0.462	0.546
Sora 22026.06	0.523	0.546	0.472	0.525	0.462	0.546
Veo 3.12026.03	0.429	0.577	0.277	0.42	0.441	0.404
Veo 3.12026.06	0.429	0.577	0.277	0.42	0.441	0.404
Runway Gen-4 Turbo2026.03	0.414	0.515	0.429	0.419	0.327	0.373
Cosmos-Predict2.5 + CollabVR2026.05	0.4	0.481	0.286	0.4	0.471	0.346
Kling 2.62026.03	0.33	0.528	0.135	0.272	0.356	0.359
Kling 2.62026.06	0.33	0.528	0.135	0.272	0.356	0.359
Wan2.2-I2V-A14B2026.03	0.329	0.405	0.308	0.343	0.236	0.307
Cosmos-Predict2.52026.05	0.304	0.368	0.169	0.309	0.377	0.274
LTX-22026.03	0.297	0.244	0.337	0.317	0.231	0.311
HunyuanVideo-I2V2026.03	0.265	0.175	0.369	0.29	0.253	0.25
CogVideoX1.5-5B-I2V2026.03	0.262	0.281	0.235	0.25	0.254	0.282