Audio Description Generation on MAD-Eval (test)
20.8ROUGE-LREAD (Ours)
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| READ (Ours)VLM=Qwen3-VL-8B, Train?=✓2026.06 | 20.8 | 22.7 | 10.4 | 10.9 | 40 | 61.7 | 36.1 | |
| READ (Ours)VLM=Qwen2-VL-7B, Train?=✓2026.06 | 20.4 | 20.7 | 9.4 | 9.8 | 39.5 | 60.2 | 35.6 | |
| DistinctADVLM=CLIPAD-B16, LLM=LLaMA3-8B, Train?=✓2026.06 | 17.6 | — | — | 8.3 | 27.3 | 56 | — | |
| Uni-ADVLM=CLIP-L14, LLM=LLaMA3-8B, Train?=✓2026.06 | 17.2 | — | — | — | 28.2 | 54.9 | — | |
| MovieSeqVLM=CLIP-B16, LLM=LLaMA2-7B, Train?=✓2026.06 | 15.5 | — | — | 7 | 24.4 | 51.6 | — | |
| Shot-by-ShotVLM=GPT-4o, LLM=GPT-4o, Train?=✗2026.06 | 15 | 15.9 | 7.4 | 8.5 | 26.9 | 56.4 | 33.5 | |
| Shot-by-ShotVLM=Qwen2-VL-7B, LLM=LLaMA3-8B, Train?=✗2026.06 | 14.7 | 16.2 | 7.2 | 7.8 | 25 | 50.6 | 27.9 | |
| AutoAD-ZeroVLM=Qwen2-VL-7B, LLM=LLaMA3-8B, Train?=✗2026.06 | 14.6 | 13.6 | 6.6 | 7.8 | 23.6 | 51.3 | — | |
| AutoAD-ZeroVLM=GPT-4o, LLM=GPT-4o, Train?=✗2026.06 | 14.3 | 13.7 | 6.7 | 8.1 | 25.4 | 54.3 | 26.7 | |
| AutoAD-IIIVLM=EVA-CLIP, LLM=LLaMA2-7B, Train?=✓2026.06 | 13.9 | 13.1 | 5.5 | 6.1 | 24 | 52.8 | — | |
| LLM-ADVLM=GPT-4V, Train?=✗2026.06 | 13.5 | — | — | — | 20.5 | — | — | |
| MM-NarratorVLM=CLIP-L14, LLM=GPT-4, Train?=✗2026.06 | 13.4 | 12.8 | 6.7 | 5.2 | 13.9 | 49 | — | |
| AutoAD-IIVLM=CLIP-B32, LLM=GPT-2, Train?=✓2026.06 | 13.4 | — | — | — | 19.5 | 51.3 | — | |
| AutoAD-IVLM=CLIP-B32, LLM=GPT-2, Train?=✓2026.06 | 11.9 | — | — | 4.4 | 13.4 | 42.1 | — |