List your company

Synchronized Video Storytelling on E-SyncVidStory (test)

33.3CIDErVideoNarrator
2.93210.81618.726.584May 22, 2024

Evaluation results

MethodLinks
VideoNarratorCategory=Fine-tuned End2end MLLMs2024.0533.39.1219.96.34.4
VideoNarratorAblation=w/o Visual Compression2024.0529.68.720.49.25.73.8
VideoNarratorAblation=w/o Video Clip Position2024.0529.58.720.19.15.63.9
VTimeLLMCategory=Fine-tuned End2end MLLMs, finetuned=true2024.05288.619.89.35.63.8
VideoNarratorAblation=w/o Storyline2024.0526.28.219.49.45.93.6
VideoNarratorAblation=w/o Visual Memory2024.0522.38.219.28.14.73.1
LLaVA-1.5+GPT-3.5Category=Multi-Model Pipelines, Protocol=Few-Shot2024.0518.68.3208.54.93.2
LLaVA-1.5+GPT-3.5Category=Multi-Model Pipelines, Protocol=Zero-Shot2024.05158.518.47.64.32.7
VideoNarratorAblation=w/o LLM LoRa finetune2024.0510.56.916.55.42.81.7
VTimeLLMCategory=End2end MLLMs2024.058.48.614.96.53.92.6
Video-LLaVACategory=End2end MLLMs2024.056.18.315.163.31.8
Video-ChatGPTCategory=End2end MLLMs2024.054.18.613.85.52.91.7