Visual Question Answering on DVQA novel (test)
99.37Accuracy (Oracle)VisionTaPas
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| VisionTaPasData Table Setting=Gold Data Table Provided2022.03 | 99.37 | — | — | |
| STL-CQAData Table Setting=Gold Data Table Not Provided2022.03 | 97.51 | — | — | |
| PREFILData Table Setting=Gold Data Table Not Provided2022.03 | 96.53 | — | 80.04 | |
| VisionTaPasData Table Setting=Gold Data Table Not Provided2022.03 | 95.46 | — | 94.54 | |
| T5Data Table Setting=Gold Data Table Provided2022.03 | 81.42 | — | — | |
| VL-T5Data Table Setting=Gold Data Table Provided2022.03 | 80.18 | — | — | |
| T5Data Table Setting=Gold Data Table Not Provided2022.03 | 77.97 | — | 76.89 | |
| VL-T5Data Table Setting=Gold Data Table Not Provided2022.03 | 77.04 | — | 76.14 | |
| TaPasData Table Setting=Gold Data Table Provided2022.03 | 53.4 | — | — | |
| TaPasData Table Setting=Gold Data Table Not Provided2022.03 | 50.24 | — | 48.68 | |
| Hybrid Model2019.09 | — | 59.54 | — | |
| PlotQA*Data Table Setting=Gold Data Table Not Provided2022.03 | — | — | 59.54 | |
| SAN2019.09 | — | 30.98 | — | |
| SANDY-OCR2019.09 | — | 45.81 | — |