Audio Question Answering on ClothoAQA
85.6AccuracyFull Model
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Full ModelBackbone=VideoLLaMA2, Sparsity=0%2025.04 | 85.6 | — | |
| DASBackbone=VideoLLaMA2, Sparsity=25%2025.04 | 71 | — | |
| Pengi2023.05 | 64.53 | — | |
| Pengi0-shot=false2024.06 | 64.5 | — | |
| PengiZero-shot=false2023.12 | 64.5 | — | |
| ShortGPTBackbone=VideoLLaMA2, Sparsity=25%2025.04 | 64.3 | — | |
| MiCo-Chat-7B0-shot=true2024.06 | 63.9 | — | |
| OWLBackbone=VideoLLaMA2, Sparsity=25%2025.04 | 60 | — | |
| Qwen-Audiozero-shot=true2023.11 | 57.9 | 74.9 | |
| OneLLM-7B0-shot=true2024.06 | 57.9 | — | |
| OneLLM-7BZero-shot=true2023.12 | 57.9 | — | |
| ClothoAQATask-specific fine-tuning=true2023.11 | 54.2 | 62.7 | |
| Shortened LLaMABackbone=VideoLLaMA2, Sparsity=25%2025.04 | 37.9 | — | |
| Ours2024.10 | 33.5 | — | |
| X-InstructBLIP2024.10 | 25.4 | — | |
| ChatBridge2024.10 | 23.3 | — | |
| MWAFM0-shot=false2024.06 | 22.2 | — | |
| MWAFMZero-shot=false2023.12 | 22.2 | — | |
| ECOFLaPBackbone=VideoLLaMA2, Sparsity=25%2025.04 | 21.3 | — | |
| LTU-7B2023.12 | 11.9 | — | |
| PengiTask-specific fine-tuning=true2023.11 | — | 64.5 |