Visual Question Answering on TextVQA (I) (test)
54.7AccuracyPretrained FT SOTA
Evaluation results
| Method | Links | |
|---|---|---|
| Pretrained FT SOTAFT=true, Shot=20K2022.04 | 54.7 | |
| FlamingoFT=false, Shot=322022.04 | 37.9 | |
| FlamingoFT=false, Shot=42022.04 | 36.5 | |
| FlamingoFT=false, Shot=02022.04 | 35 | |
| Flamingo-9BFT=false, Shot=42022.04 | 33.6 | |
| Flamingo-3BFT=false, Shot=42022.04 | 32.7 | |
| Flamingo-9BFT=false, Shot=322022.04 | 32.6 | |
| Flamingo-9BFT=false, Shot=02022.04 | 31.8 | |
| Flamingo-3BFT=false, Shot=322022.04 | 30.6 | |
| Flamingo-3BFT=false, Shot=02022.04 | 30.1 |