Video Question Answering on TemporalBench
49.8VYRBaseline (Qwen3-VL-8B-Instruct)
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Baseline (Qwen3-VL-8B-Instruct)Backbone=Qwen3-VL-8B-Instruct2026.04 | 49.8 | 87.9 | 88.8 | 4.261 | 12.1 | 1.6 | 83.2 | 80.7 | 1.323 | 2.041 | 1.163 | 0.817 | 1.868 | 24.2 | |
| Baseline+CoTBackbone=Qwen3-VL-8B-Instruct, Chain-of-Thought=true2026.04 | 48.1 | 87.4 | 88.3 | 4.266 | 12.6 | 2.2 | 83.1 | 78.4 | 1.335 | 0.81 | 1.213 | 0.654 | 0.299 | 32.7 | |
| Baseline+SFTBackbone=Qwen3-VL-8B-Instruct, Supervised Fine-Tuning=true2026.04 | 44 | 83.8 | 84.7 | 4.268 | 16.2 | 1.6 | 80.1 | 73.8 | 1.283 | 1.014 | 1.672 | 1.13 | 0.455 | 34.8 | |
| Qwen3-VL-30BParameters=30B2026.04 | 43.6 | 80.1 | 80.7 | 4.275 | 15.7 | 2.7 | 82.3 | 72.8 | 1.271 | 0.365 | 1.564 | 1.894 | 1.367 | 38.3 | |
| Baseline+CoT+SFTBackbone=Qwen3-VL-8B-Instruct, Chain-of-Thought=true, Supervised Fine-Tuning=true2026.04 | 39.9 | 76.3 | 77.7 | 4.297 | 23.7 | 13.3 | 74.4 | 66.6 | 1.104 | 1.217 | 1.536 | 1.813 | 0.516 | 39.6 | |
| Internvl3.5-VL-241BParameters=241B2026.04 | 38.4 | 76.7 | 79.1 | 4.261 | 25.9 | 1.6 | 84.1 | 73.6 | 1.143 | 0.671 | 1.613 | 2.016 | 0.398 | 40.5 | |
| Qwen3-VL-235BParameters=235B2026.04 | 36.6 | 73.2 | 75.8 | 4.257 | 26.7 | 1.2 | 82.6 | 71.7 | 1.079 | 0.591 | 1.657 | 1.946 | 0.214 | 41.6 | |
| Gemini-3.1-Pro2026.04 | 15.2 | 38 | 38.2 | 4.242 | 61.9 | 9.6 | 45.8 | 20.5 | 0.331 | 0.374 | 0.364 | 1.135 | 0.216 | 62.5 | |
| VTHM-MoE2026.04 | 0.4 | 47.3 | 47.3 | 4.223 | 52.7 | 9.6 | 49.3 | 2.2 | 0.076 | 0.307 | 0.757 | 0.367 | 0.892 | 53.1 |