Audio-Visual Question Answering on AVQA (val)
88.24Existence AccuracyMEERKAT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| MEERKATGeneralist=true2024.07 | 88.24 | 86.65 | 86.55 | |
| X-InstructBLIPGeneralist=true2024.07 | 85.53 | 80.09 | 83.91 | |
| VideoLlamaGeneralist=true2024.07 | 84.48 | 77.06 | 81.36 | |
| CADGeneralist=false2024.07 | 83.42 | — | 76.16 | |
| PandaGPTGeneralist=true2024.07 | 83.38 | 76.81 | 79.11 | |
| Macaw-LLMGeneralist=true2024.07 | 82.19 | 74.86 | 78.98 | |
| ST-AVQAGeneralist=false2024.07 | 81.81 | 64.51 | 63.23 | |
| AVSDGeneralist=false2024.07 | 81.61 | 58.79 | 61.41 | |
| PanoAVQAGeneralist=false2024.07 | 81.21 | 59.33 | 63.23 |