List your company
ResearchFormerly WizWand

Proactive VideoQA on SPOT-Bench

49.5Detection ABD Timeliness Score@5Qwen2.5-VL
-1.9811.38524.7538.115Apr 27, 2026
Updated 6mo ago

Evaluation results

MethodLinks
Qwen2.5-VL# Frames=16, Post Train?=false, Model Size=7B, Backbone=Qwen2.5-VL [8]2026.0449.58.349.45.427.52.941.2000021.73
Qwen2.5-VL# Frames=4, Post Train?=false, Model Size=7B, Backbone=Qwen2.5-VL [8]2026.0449.31044.76.216.93.63.21.20000193.5
Qwen2.5-VL# Frames=1, Post Train?=false, Model Size=7B, Backbone=Qwen2.5-VL [8]2026.0444.91231.37.43.61.52.20.8000013.73.6
AsynKV# Frames=1fps, Post Train?=false, Model Size=7B, Backbone=Qwen2.5-VL [8]2026.0440.222.636.819.530.8181.21000018.210.2
StreamingVLM# Frames=2fps, Post Train?=true, Model Size=7B, Backbone=Qwen2.5-VL [8]2026.048.24.85.52.131.60.91.20.33.20.72.40.58.71.6
MMDuet2 + KVflush# Frames=1fps, Post Train?=true, Model Size=3B, Backbone=Qwen2.5-VL [8]2026.046.27.53.54.837.85.32.6300008.43.4
MMDuet2 + StreamingVLM# Frames=1fps, Post Train?=true, Model Size=3B, Backbone=Qwen2.5-VL [8]2026.0411.74.96.631412.200006.32.4
Qwen2.5-VL# Frames=0, Post Train?=false, Model Size=7B, Backbone=Qwen2.5-VL [8]2026.0400000000000000