Movie Audio Description generation on MAD-eval-Named v2 (test)
28.2C ScoreUni-AD
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Uni-ADContextual Information=true, Language Model=LLaMA2, Visual Feature=CLIP-L142024.03 | 28.2 | 17.1 | — | — | 54.2 | |
| Uni-ADContextual Information=false, Language Model=LLaMA2, Visual Feature=CLIP-L142024.03 | 27.3 | 16.8 | — | — | 53.3 | |
| Uni-ADContextual Information=false, Language Model=GPT-2, Visual Feature=CLIP-L142024.03 | 25.7 | 16.4 | — | — | 51.5 | |
| AutoAD-IIIContextual Information=false, Language Model=LLaMA2, Visual Feature=EVA-CLIP2024.03 | 24 | — | — | — | 52.8 | |
| Uni-ADContextual Information=false, Language Model=GPT-2, Visual Feature=CLIP-B322024.03 | 24 | 15.9 | — | — | 50.5 | |
| AutoAD-ZeroContextual Information=false, Language Model=LLaMA3, Visual Feature=VideoLLaMA22024.03 | 22.4 | — | — | — | — | |
| AutoAD-IIContextual Information=true, Language Model=GPT-2, Visual Feature=CLIP-B322024.03 | 19.5 | 13.4 | — | — | 50.8 | |
| AutoAD-IIContextual Information=false, Language Model=GPT-2, Visual Feature=CLIP-B322024.03 | 19.2 | 13.1 | — | — | 51.3 | |
| AutoADPretraining Data=AV-AD & WebVid2023.03 | 14.3 | 11.9 | 4.4 | 24.2 | — | |
| AutoAD-IContextual Information=true, Language Model=GPT-2, Visual Feature=CLIP-B322024.03 | 14.3 | 11.9 | — | — | 42.1 | |
| AutoADPretraining Data=AV-AD2023.03 | 14.1 | 12.1 | 4.2 | 23 | — | |
| MM-NarratorContextual Information=true, Language Model=GPT-4, Visual Feature=CLIP-L142024.03 | 13.9 | 15.1 | — | — | 49 | |
| AutoAD-IContextual Information=false, Language Model=GPT-2, Visual Feature=CLIP-B322024.03 | 12.1 | 10.3 | — | — | 39.8 | |
| MM-NarratorContextual Information=true, Language Model=GPT-4V, Visual Feature=CLIP-L142024.03 | 9.8 | 12.8 | — | — | — | |
| CapDec*Pretraining Data=AV-AD2023.03 | 6.7 | 8.2 | 1.4 | 14.3 | — | |
| ClipCapPretraining Data=CC3M2023.03 | 4.4 | 8.5 | 1.1 | 11.8 | — | |
| ClipCapContextual Information=false, Language Model=GPT-2, Visual Feature=CLIP-B322024.03 | 4.4 | 8.5 | — | — | 36.5 |