Visual Question Answering on TallyQA (test)
86.2Simple AccuracyPaLI-X-VPD
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PaLI-X-VPDScale=55B, Type=generalist2023.12 | 86.2 | 76.6 | |
| PaLI-X-VPDScale=55B, Type=specialist2023.12 | 86.2 | 76.4 | |
| PaLI-XCategory=Specialist2023.12 | 86 | 75.6 | |
| PaLI-XScale=55B2023.12 | 86 | 75.6 | |
| PaLI-XFTCategory=Generalist, Fine-tuned=true2023.12 | 83.8 | 71.8 | |
| SMOLA-PALI-XFTCategory=Generalist, Fine-tuned=true2023.12 | 83.3 | 70.7 | |
| PaLI-3Scale=5B2023.12 | 83.3 | 70.5 | |
| PaLI-3-VPDScale=5B, Type=specialist2023.12 | 83.3 | 70.8 | |
| PaLI-3-VPDScale=5B, Type=generalist2023.12 | 83.1 | 70.9 | |
| SMOLA48-PaLI-3FTCategory=Generalist, Fine-tuned=true2023.12 | 81.8 | 65.1 | |
| PaLIScale=17B2023.12 | 81.7 | 70.9 | |
| PaLI-3FTCategory=Generalist, Fine-tuned=true2023.12 | 80.4 | 65.4 |