Visual Question Answering on DVQA familiar (test)
99.36Accuracy (Oracle)VisionTaPas
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VisionTaPasData Table Setting=Gold Data Table Provided2022.03 | 99.36 | — | |
| VL-T5Data Table Setting=Gold Data Table Provided2022.03 | 98.9 | — | |
| STL-CQAData Table Setting=Gold Data Table Not Provided2022.03 | 97.35 | — | |
| PREFILData Table Setting=Gold Data Table Not Provided2022.03 | 96.37 | 80.88 | |
| VisionTaPasData Table Setting=Gold Data Table Not Provided2022.03 | 95.38 | 94.43 | |
| VL-T5Data Table Setting=Gold Data Table Not Provided2022.03 | 94.8 | 93.75 | |
| T5Data Table Setting=Gold Data Table Provided2022.03 | 94.33 | — | |
| T5Data Table Setting=Gold Data Table Not Provided2022.03 | 90.2 | 89.01 | |
| TaPasData Table Setting=Gold Data Table Provided2022.03 | 53.4 | — | |
| TaPasData Table Setting=Gold Data Table Not Provided2022.03 | 50.28 | 48.82 | |
| PlotQA*Data Table Setting=Gold Data Table Not Provided2022.03 | — | 57.99 |