List your company
ResearchFormerly WizWand

Video Question Answering on WorldSense

54AccuracyQwen3-Omni-30B-A3B-Instruct
4.70417.50230.343.098Mar 12, 2026Mar 26, 2026Apr 10, 2026Apr 24, 2026May 9, 2026May 23, 2026Jun 7, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Qwen3-Omni-30B-A3B-InstructEvaluation Setting=Direct QA2026.0654
Gemini-2.5-FlashEvaluation Setting=Direct QA2026.0650.9
OmniCaptioner-IF-7BEvaluation Setting=Direct QA2026.0649.4
R-MSD (4B)Frames=642026.0349.2
video-SALMONN-2-7BEvaluation Setting=Direct QA2026.0648.6
Qwen3-VL-4B-InstructFrames=642026.0346.7
Original SFT+RL (4B)Frames=642026.0346.3
R-MSD (2B)Frames=642026.0345.7
Qwen2.5-Omni-7BEvaluation Setting=Direct QA2026.0645.4
OmniCaptioner-IF-7BEvaluation Protocol=Caption-to-QA, LLM-as-a-judge=Gemini-2.5-Pro2026.0643.2
Qwen3-VL-2B-InstructFrames=642026.0342.6
GPT-4oEvaluation Setting=Direct QA2026.0642.6
ASID-Captioner-7BEvaluation Protocol=Caption-to-QA, LLM-as-a-judge=Gemini-2.5-Pro2026.0634
Gemini-2.5-ProEvaluation Protocol=Caption-to-QA, LLM-as-a-judge=Gemini-2.5-Pro2026.0633.8
Gemini-2.5-FlashEvaluation Protocol=Caption-to-QA, LLM-as-a-judge=Gemini-2.5-Pro2026.0631
AVoCaDO-7BEvaluation Protocol=Caption-to-QA, LLM-as-a-judge=Gemini-2.5-Pro2026.0625.7
VideoLLaMA2-7BEvaluation Setting=Direct QA2026.0625.4
video-SALMONN-2-7BEvaluation Protocol=Caption-to-QA, LLM-as-a-judge=Gemini-2.5-Pro2026.0618.2
Qwen3-Omni-Instruct-30B-A3BEvaluation Protocol=Caption-to-QA, LLM-as-a-judge=Gemini-2.5-Pro2026.0612.7
UGC-VideoCaptioner-3BEvaluation Protocol=Caption-to-QA, LLM-as-a-judge=Gemini-2.5-Pro2026.0611.2
ARC-Hunyuan-Video-7BEvaluation Protocol=Caption-to-QA, LLM-as-a-judge=Gemini-2.5-Pro2026.068.7
Qwen2.5-Omni-7BEvaluation Protocol=Caption-to-QA, LLM-as-a-judge=Gemini-2.5-Pro2026.068.6
MiniCPM-o-2.6-8BEvaluation Protocol=Caption-to-QA, LLM-as-a-judge=Gemini-2.5-Pro2026.067.2
HumanOmniV2-7BEvaluation Protocol=Caption-to-QA, LLM-as-a-judge=Gemini-2.5-Pro2026.066.6