List your company
ResearchFormerly WizWand

Video Question Answering on IntentQA (val)

86.6AccuracyMM1.5-Video-7B
59.0466.19573.3580.505Sep 30, 2024
Updated 8mo ago

Evaluation results

MethodLinks
MM1.5-Video-7BTraining Mode=SFT, Video Data=true, Model Size=7B2024.0986.6
VideoChat2-7BTraining Mode=SFT, Video Data=true, Model Size=7B2024.0981.9
MM1.5-Video-3BTraining Mode=SFT, Video Data=true, Model Size=3B2024.0981.2
MM1.5-Video-7BTraining Mode=Training-free, Video Data=false, Model Size=7B2024.0976.7
MM1.5-Video-1BTraining Mode=SFT, Video Data=true, Model Size=1B2024.0974.2
MM1.5-Video-3BTraining Mode=Training-free, Video Data=false, Model Size=3B2024.0972.7
MM1.5-Video-1BTraining Mode=Training-free, Video Data=false, Model Size=1B2024.0967.8
IG-VLM-7B (LLaVA-v1.6)Training Mode=Training-free, Video Data=false, Model Size=7B2024.0960.3
SlowFast-LLaVA-7BTraining Mode=Training-free, Video Data=false, Model Size=7B2024.0960.1