Video Dialogue on AVSD DSTC8 (test)
47.5BLEU-4V²Dial
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| V²DialTraining=Fine-tuned2025.03 | 47.5 | 76.8 | 65.5 | 55.8 | 30.4 | 62.1 | 135.7 | |
| V²DialFine-tuning=true2025.03 | 47.5 | 76.8 | 65.5 | 55.8 | 30.4 | 62.1 | 135.7 | |
| MST-MIXERTraining=Fine-tuned2025.03 | 47.1 | 77.1 | 65.6 | 55.7 | 30.2 | 61.8 | 133.6 | |
| MST-MIXERFine-tuning=true2025.03 | 47.1 | 77.1 | 65.6 | 55.7 | 30.2 | 61.8 | 133.6 | |
| THAMTraining=Fine-tuned2025.03 | 45.5 | 76.4 | 64.1 | 53.8 | 30.1 | 61 | 130.4 | |
| THAMFine-tuning=true2025.03 | 45.5 | 76.4 | 64.1 | 53.8 | 30.1 | 61 | 130.4 | |
| DialogMCFTraining=Fine-tuned2025.03 | 44.9 | 75.6 | 63.3 | 53.2 | 29.3 | 60.1 | 125.3 | |
| DialogMCFFine-tuning=true2025.03 | 44.9 | 75.6 | 63.3 | 53.2 | 29.3 | 60.1 | 125.3 | |
| RLMTraining=Fine-tuned2025.03 | 44.5 | 74.6 | 62.6 | 52.8 | 28.6 | 59.8 | 124 | |
| P-DCITraining=Fine-tuned2025.03 | 43.9 | 74.9 | 62.9 | 52.8 | 28.5 | 59.2 | 120.1 | |
| PDCFine-tuning=true2025.03 | 43.9 | 74.9 | 62.9 | 52.8 | 28.5 | 59.2 | 120.1 | |
| SCGATraining=Fine-tuned2025.03 | 41.6 | 71.1 | 59.3 | 49.7 | 27.6 | 56.6 | 112.3 | |
| AV-TRNTraining=Fine-tuned2025.03 | 39.4 | — | — | — | 25 | 54.5 | 99.7 | |
| COSTTraining=Fine-tuned2025.03 | 38.2 | 69.5 | 55.9 | 46.5 | 27.8 | 57.4 | 105.1 | |
| BISTTraining=Fine-tuned2025.03 | 37.6 | 68.4 | 54.8 | 45.7 | 27.3 | 56.3 | 101.7 | |
| JMANTraining=Fine-tuned2025.03 | 32.4 | 64.5 | 50.4 | 40.2 | 23.2 | 52.1 | 87.5 | |
| VideoLLAMA 2Training=Fine-tuned, Note=Marked with asterisk in source2025.03 | 22.2 | 53.3 | 39 | 29.1 | 24.8 | 46.3 | 74 | |
| VideoLLAMA 2Fine-tuning=true2025.03 | 22.2 | 53.3 | 39 | 29.1 | 24.8 | 46.3 | 74 | |
| V2DialMode=Zero-shot2025.03 | 16.7 | 53.2 | 33.8 | 23.5 | 18.8 | 37.7 | 49.7 | |
| VideoChat2Mode=Zero-shot2025.03 | 12.6 | 43.9 | 28.1 | 18.5 | 20.8 | 34.5 | 29.2 | |
| MOE-LLAVAMode=Zero-shot2025.03 | 10.1 | 39.8 | 23.9 | 15.2 | 18.7 | 32.2 | 23.7 | |
| Video-ChatGPTMode=Zero-shot2025.03 | 6.4 | 25.5 | 16 | 10.1 | 18.4 | 27.1 | 9.1 | |
| MiniGPT4-videoMode=Zero-shot2025.03 | 5.8 | 34.8 | 17.6 | 9.7 | 15.8 | 26.3 | 13.3 | |
| MST-MIXERMode=Zero-shot2025.03 | 0 | 0.2 | 0.1 | 0.1 | 3.3 | 7.1 | 4.3 |