List your company

Video Question Answering on TVQA zero-shot (test)

50.2AccuracyTOPA-Llama2-13B
28.8834.41539.9545.485May 22, 2024

Evaluation results

MethodLinks
TOPA-Llama2-13BNumber of Frames=10, Evaluation Protocol=Zero-shot2024.0550.2
TOPA-Llama3-8BNumber of Frames=10, Evaluation Protocol=Zero-shot2024.0548.5
TOPA-Llama2-7BNumber of Frames=10, Evaluation Protocol=Zero-shot2024.0548.2
IG-VLM-Llava13BNumber of Frames=6, Evaluation Protocol=Zero-shot2024.0544.5
IG-VLM-Llava7BNumber of Frames=6, Evaluation Protocol=Zero-shot2024.0542.1
SeViLANumber of Frames=32, Evaluation Protocol=Zero-shot2024.0538.2
InternVideoNumber of Frames=8, Evaluation Protocol=Zero-shot2024.0535.9
FrozenBiLMNumber of Frames=10, Evaluation Protocol=Zero-shot2024.0529.7