Overall Audio-Visual Question Answering on MUSIC-AVQA (test)
71.52Overall AccuracySpatio-Temporal Grounded Audio-Visual Network
Evaluation results
| Method | Links | |
|---|---|---|
| Spatio-Temporal Grounded Audio-Visual NetworkModel Domain=AVQA2022.03 | 71.52 | |
| Pano-AVQAModel Domain=AVQA2022.03 | 68.93 | |
| AVSDModel Domain=AVQA2022.03 | 67.44 | |
| GRUModel Domain=AudioQA2022.03 | 67.07 | |
| PSACModel Domain=VisualQA2022.03 | 66.54 | |
| HMEModel Domain=VideoQA2022.03 | 66.45 | |
| MCANModel Domain=VisualQA2022.03 | 65.49 | |
| CONVLSTMModel Domain=AudioQA2022.03 | 63.65 | |
| HCAttnModel Domain=VisualQA2022.03 | 62.3 | |
| FCNLSTMModel Domain=AudioQA2022.03 | 60.34 | |
| BiLSTM AttnModel Domain=VisualQA2022.03 | 59.92 | |
| HCRNModel Domain=VideoQA2022.03 | 55.73 | |
| CREMAModality=V, A, Total Params.=4.2B, Zero-shot=true2024.02 | 52.6 | |
| CREMAModality=V, Total Params.=4.1B, Zero-shot=true2024.02 | 51 | |
| OneLLMModality=V, Total Params.=7.8B, Zero-shot=true2024.02 | 48.4 | |
| X-InstructBLIPModality=V, A, Total Params.=14.4B, Zero-shot=true2024.02 | 44.5 | |
| X-InstructBLIPModality=V, Total Params.=14.1B, Zero-shot=true2024.02 | 43.5 | |
| OneLLMModality=V, A, Total Params.=7.8B, Zero-shot=true2024.02 | 42.3 | |
| OneLLMModality=A, Total Params.=7.8B, Zero-shot=true2024.02 | 34.8 | |
| CREMAModality=A, Total Params.=3.2B, Zero-shot=true2024.02 | 31 | |
| X-InstructBLIPModality=A, Total Params.=13.2B, Zero-shot=true2024.02 | 22.7 |