Video Captioning on MSRVTT
80.3CIDErmPLUG-2
Evaluation results
| Method | Links | |
|---|---|---|
| mPLUG-2number of frames=162023.10 | 80.3 | |
| MiCo2024.06 | 79.3 | |
| PaLI-3number of frames=162023.10 | 78.3 | |
| VASTmodality track=Multi-modal2023.05 | 78 | |
| PaLI-XNumber of frames=162023.05 | 76.8 | |
| GIT22023.05 | 75.9 | |
| GIT22023.03 | 75.9 | |
| Method [19]modality track=Vision-only2023.05 | 75.9 | |
| PaLI-XNumber of frames=82023.05 | 74.6 | |
| Method [7]modality track=Multi-modal2023.05 | 74 | |
| SOTA2024.06 | 74 | |
| GIT2023.03 | 73.9 | |
| MaMMUTpre-training=image-language only, finetuning=direct2023.03 | 73.6 | |
| Video-Coca2023.03 | 73.2 | |
| HiTeA# PT Data=17M2022.12 | 65.1 | |
| Vid2Seq2023.03 | 64.6 | |
| ClusterSTM#Pairs=5M2026.03 | 64.4 | |
| STM#Pairs=5M2026.03 | 63.9 | |
| HiTeA# PT Data=5M2022.12 | 62.5 | |
| HiTeA#Pairs=5M2026.03 | 62.5 | |
| MV-GPT# PT Data=53M2022.12 | 60 | |
| MV-GPT# Pretrain videos/images=53M2022.09 | 60 | |
| MV-GPT2023.03 | 60 | |
| MV-GPT#Pairs=53M, pretrained on more data=true2026.03 | 60 | |
| X-InstructBLIP2024.10 | 58.8 | |
| LAVENDER# PT Data=5M2022.12 | 58 | |
| VIOLETV2# Pretrain videos/images=5M2022.09 | 58 | |
| VIOLETV22023.03 | 58 | |
| VIOLETv2#Pairs=5M2026.03 | 58 | |
| LAVENDER#Pairs=5M2026.03 | 58 | |
| CLIP4Caption# PT Data=400M2022.12 | 57.7 | |
| SwinBERT2022.12 | 53.8 | |
| SwinBERT2022.09 | 53.8 | |
| SWINBert2023.03 | 53.8 | |
| SwinBERT#Pairs=5M2026.03 | 53.8 | |
| OpenBook2023.03 | 52.9 | |
| Ours2024.10 | 52.8 | |
| LVLMModel Scale=13B2026.01 | 52.3 | |
| ORG-TRL2023.03 | 50.9 | |
| LVLMModel Scale=7B2026.01 | 50.9 | |
| UniVL# PT Data=180M2022.12 | 49.9 | |
| PLLaVAModel Scale=13B2026.01 | 49.5 | |
| PLLaVAModel Scale=7B2026.01 | 49 | |
| UIO-2XXLModel Size=XXL2023.12 | 48.8 | |
| FlamingoModel Size=80B2023.12 | 47.4 | |
| UIO-2XLModel Size=XL2023.12 | 47.1 | |
| Tarsier-34BZero-shot=true2024.06 | 44.7 | |
| ST-LLM2026.01 | 44.3 | |
| UIO-2LModel Size=L2023.12 | 44 | |
| InternVideo2Zero-shot=true2024.06 | 43.5 | |
| MA-LMM2026.01 | 43.3 | |
| VideoChat22026.01 | 42.7 | |
| GPT4Video2026.01 | 42.3 | |
| LLaMA-VID2026.01 | 41.3 | |
| Chat-UniVi2026.01 | 39.8 | |
| Video-LLaVA2026.01 | 39.4 | |
| VALLEY2026.01 | 39 | |
| VideoPrismZero-shot=true2024.06 | 38.5 | |
| PandaZero-shot=true2024.06 | 31.5 | |
| Video-ChatGPT2026.01 | 30.6 | |
| FlamingoModel Size=9B, Few-shot=true2023.12 | 29.4 | |
| Video-LLaMAZero-shot=true2024.06 | 29.1 | |
| VideoCocaZero-shot=true2024.06 | 27.1 | |
| EmuFew-shot=true2023.12 | 24.1 | |
| Tarsier-7BZero-shot=true2024.06 | 24.1 | |
| InstructBLIPZero-shot=true2023.12 | 22.1 | |
| BLIP2Zero-shot=true2024.06 | 19 | |
| BLIP-2Zero-shot=true2023.12 | 9.2 |