Long-video understanding on Video-Holmes (test) benchmark leaderboard · SOTA2 Research

Long-video understanding on Video-Holmes (test)

43.4Video-Holmes ScoreQwen3-VL-8B-Thinking + FrameRepeat

Evaluation Results

Method	Links
Qwen3-VL-8B-Thinking + FrameRepeat2026.03		43.4
Qwen3-VL-8B-Thinking + CLIP-K2026.03		41.5
Qwen3-VL-8B-Thinking2026.03		41
Qwen3-VL-8B-Thinking + Bottom-K2026.03		41
Qwen3-VL-8B-Thinking + FrameRepeat2026.03		40.5
Qwen3-VL-8B-Thinking + CLIP-K2026.03		40.2
Qwen3-VL-8B-Thinking + Random-K2026.03		40.2
Qwen3-VL-8B-Thinking2026.03		40
Qwen3-VL-8B-Thinking + Bottom-K2026.03		39.3
Qwen3-VL-8B-Thinking + Random-K2026.03		39.3
Qwen2.5-VL-7B-Instruct + FrameRepeat2026.03		36
Qwen2.5-VL-7B-Instruct + CLIP-K2026.03		35.1
Qwen2.5-VL-7B-Instruct + Bottom-K2026.03		35.1
Qwen2.5-VL-7B-Instruct2026.03		35
Qwen2.5-VL-7B-Instruct + Random-K2026.03		35
Qwen2.5-VL-7B-Instruct + FrameRepeat2026.03		34.9
Qwen2.5-VL-7B-Instruct + Random-K2026.03		33.7
Qwen2.5-VL-7B-Instruct2026.03		33.4
Qwen2.5-VL-7B-Instruct + Bottom-K2026.03		33.4
Qwen2.5-VL-7B-Instruct + CLIP-K2026.03		33