Audio-Visual Question Answering on AVSD (test)
165.1CIDErUniMVU
Evaluation results
| Method | Links | ||
|---|---|---|---|
| UniMVUSize=7B, Training regime=task-specific training2026.05 | 165.1 | 39.8 | |
| UniMVU†Size=7B, Training regime=unified multi-task training2026.05 | 162.7 | 39.5 | |
| PAVE*Size=7B, Evaluation protocol=reproduced baseline2026.05 | 151.6 | 38.5 | |
| UniMVUSize=0.5B, Training regime=task-specific training2026.05 | 147.1 | 38.2 | |
| UniMVU†Size=0.5B, Training regime=unified multi-task training2026.05 | 145.9 | 37.8 | |
| PAVE*Size=0.5B, Evaluation protocol=reproduced baseline2026.05 | 134.9 | 36.5 | |
| LLaVA-OV-FT* (video-audio concat)Size=0.5B, Input modalities=video-audio concat, Evaluation protocol=reproduced baseline2026.05 | 127.8 | 35.7 | |
| LLaVA-OV-FT (video-only)Size=7B, Input modalities=video-only2026.05 | 124.9 | — | |
| LLaVA-OV-FT (video-only)Size=0.5B, Input modalities=video-only2026.05 | 117.6 | — | |
| COSTzero-shot=false2024.03 | 108.5 | — | |
| MTNzero-shot=false2024.03 | 98.5 | — | |
| FA+HREDzero-shot=false2024.03 | 84.3 | — | |
| CAT-7Bzero-shot=true2024.03 | 79 | — | |
| ChatBridge-13Bzero-shot=true2024.03 | 75.4 | — | |
| OneLLM-7Bzero-shot=true2024.03 | 74.5 | — |