Visual Question Answering on WebQA image segment 1.0 (test)
49.8AccuracyMI-BART
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MI-BARTImage context source=Oracle Images2023.06 | 49.8 | 51.1 | 2,810 | |
| Image stitch MI-BARTImage context source=Oracle Images2023.06 | 49.6 | 50.5 | 2,750 | |
| Image stitch MI-BARTImage context source=Retrieved Images2023.06 | 49.1 | 50.3 | 2,740 | |
| MI-BARTImage context source=Retrieved Images2023.06 | 48.7 | 50.7 | 2,760 | |
| VLPImage context source=Oracle Images2023.06 | 45.7 | 42.2 | 2,590 | |
| VLPImage context source=Retrieved Images2023.06 | 44.2 | 38.9 | 2,410 | |
| Per-category popularityImage context source=Oracle Images2023.06 | 25.2 | 1.3 | 50 | |
| Per-category popularityImage context source=Retrieved Images2023.06 | 25.2 | 1.3 | 50 | |
| Question onlyImage context source=Oracle Images2023.06 | 22.2 | 34.9 | 1,340 | |
| Question onlyImage context source=Retrieved Images2023.06 | 22.2 | 34.9 | 1,340 | |
| Global popularityImage context source=Oracle Images2023.06 | 17.7 | 1.3 | 40 | |
| Global popularityImage context source=Retrieved Images2023.06 | 17.7 | 1.3 | 40 |