Visual Question Answering on VQA v2 (dev)
84.3AccuracyPALI (16.9B)
Evaluation results
| Method | Links | |
|---|---|---|
| PALI (16.9B)#Example=1.6B2023.04 | 84.3 | |
| CoCa#Example=4.8B2023.04 | 82.3 | |
| Flamingo (80B)#Example=2.3B2023.04 | 82 | |
| GIT2 (5.1B)#Example=12.9B2023.04 | 81.7 | |
| Florence#Example=900M2023.04 | 80.16 | |
| SimVLM#Example=1.8B2023.04 | 80.03 | |
| METERData=16M+, EPIC=true2022.11 | 78.6 | |
| GIT#Example=800M2023.04 | 78.6 | |
| X-VLMData=4M+, EPIC=true2022.11 | 78.5 | |
| VALORL#Example=33.5M, Resolution=3922023.04 | 78.46 | |
| METERData=16M+, EPIC=false2022.11 | 78.3 | |
| X-VLMData=16M+, EPIC=true2022.11 | 78.3 | |
| BLIP#Example=135M2023.04 | 78.25 | |
| X-VLMData=4M+, EPIC=false2022.11 | 78.1 | |
| X-VLMData=16M+, EPIC=false2022.11 | 78 | |
| METERData=4M+, EPIC=true2022.11 | 77.9 | |
| METERData=4M+, EPIC=false2022.11 | 77.7 | |
| METER#Example=10M2023.04 | 77.68 | |
| ALBEFData=16M+, EPIC=true2022.11 | 76.7 | |
| UFO#Example=10M2023.04 | 76.64 | |
| VinVL#Example=10M2023.04 | 76.52 | |
| ALBEF#Example=20M2023.04 | 75.84 | |
| ALBEFData=16M+, EPIC=false2022.11 | 75.8 | |
| GITL#Example=20M2023.04 | 75.5 | |
| ALBEFData=4M+, EPIC=true2022.11 | 75.1 | |
| ALBEFData=4M+, EPIC=false2022.11 | 74.6 | |
| UNITER#Example=10M2023.04 | 73.82 | |
| Oscar#Example=10M2023.04 | 73.61 | |
| ViLTData=4M, EPIC=true2022.11 | 71.8 | |
| ViLTData=4M, EPIC=false2022.11 | 71.3 |