Visual Question Answering on VQA-X e-ViL (test)
89.9Human Evaluation ScoreGround-truth
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Ground-truth2022.12 | 89.9 | — | — | — | |
| OFA-Xmodel_variant=large (470M parameters), training=single-task fine-tuned2022.12 | 89.5 | 24.5 | 87.2 | 91.2 | |
| OFA-XMTmodel_variant=large (470M parameters), training=multi-task pre-training (e-ViL-combined)2022.12 | 87.8 | 23.1 | 86.8 | 92.6 | |
| NLX-GPT2022.12 | 83.2 | 23.1 | 86.9 | 83 | |
| e-UG2022.12 | 71.5 | 22.1 | 87 | 80.5 | |
| PJ-X2022.12 | 65.4 | 19.7 | 84.6 | 76.4 | |
| FME2022.12 | 63.2 | 20.4 | 85.2 | 75.5 |