List your company
ResearchFormerly WizWand

Video Question Answering on MSRVTT-MC

97.7AccuracyUMT-L
30.41247.88165.3582.819Jun 3, 2022Aug 15, 2022Oct 27, 2022Jan 8, 2023Mar 22, 2023Jun 3, 2023Aug 16, 2023
Updated 8mo ago

Evaluation results

MethodLinks
UMT-L#Pairs=17M2023.0397.7
VIOLETV2# Pretrain videos/images=5M2022.0997.6
UMT-L#Pairs=25M2023.0397.3
VINDLU#Pairs=25M2023.0397.1
UMT-L#Pairs=5M2023.0396.8
UMT-B#Pairs=17M2023.0396.3
UMT-B#Pairs=25M2023.0396.3
UMT-B#Pairs=5M2023.0395.9
VINDLU#PT=25M2022.1295.5
VINDLU#PT=5M2022.1295.4
Tem-adapter2023.0894.3
Tem-adapter2023.0894.3
VINDLU#PT=17M2022.1293.8
Singularity#PT=17M2022.1293.7
Singularity#Pairs=17M2023.0393.7
SimVTP2022.1293.6
ATPNumber of sampled frames (n)=16, embeddings chosen=12022.0693.2
ATPYear=20222023.0893.2
ATPYear=20222023.0893.2
ATPNumber of sampled frames (n)=8, embeddings chosen=12022.0692.5
All-in-one# Pretrain videos/images=283M2022.0992.3
VideoCLIP#PT=136M, #Train Frame=9602022.0692.1
SINGULARITY#PT=17M, #Train Frame=12022.0692.1
VideoCLIP2022.0692.1
VideoCLIP#PT=136M2022.1292.1
VideoCLIPYear=20192023.0892.1
VideoCLIPYear=20192023.0892.1
VideoCLIP#Pairs=136M2023.0392.1
All-in-one#PT=138M, #Train Frame=92022.0692
SINGULARITY#PT=5M, #Train Frame=12022.0692
All-in-one#PT=138M2022.1292
All-in-one#Pairs=138M2023.0392
VIOLET2022.1291.9
VIOLET#PT=138M2022.1291.9
VIOLET# Pretrain videos/images=186M2022.0991.9
VIOLET#Pairs=138M2023.0391.9
ATPNumber of sampled frames (n)=4, embeddings chosen=12022.0691.4
MERLOT#PT=180M, #Train Frame=52022.0690.9
MERLOT2022.0690.9
MERLOT2022.1290.9
MERLOT#PT=180M2022.1290.9
MERLOT# Pretrain videos/images=180M2022.0990.9
MERLOTYear=20212023.0890.9
MERLOTYear=20212023.0890.9
MERLOT#Pairs=180M2023.0390.9
ClipBERT#PT=0.2M, #Train Frame=162022.0688.2
ClipBERT2022.0688.2
ClipBert2022.1288.2
ClipBERT#PT=0.2M2022.1288.2
ClipBERT# Pretrain videos/images=0.2M2022.0988.2
ClipBERTYear=20212023.0888.2
ClipBERTYear=20212023.0888.2
ClipBERT#Pairs=0.2M2023.0388.2
ActBERT2022.0685.7
ActBERTYear=20202023.0885.7
ActBERTYear=20202023.0885.7
CLIPmode=single-frame2022.0684.8
JSFusion2022.1283.4
CLIPYear=20212023.0874.1
CLIPYear=20212023.0874.1
HTGS2022.1233