Scene Text Visual Question Answering on ST-VQA (val)
0.845ANLSPaLI-X
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PaLI-XOCR pipeline input=true2023.05 | 0.845 | — | |
| PaLIOCR pipeline input=true2023.05 | 0.799 | — | |
| PaLI-XOCR pipeline input=false2023.05 | 0.799 | — | |
| PaLI-17BVocabulary setting=Open-vocabulary generation2022.09 | 0.771 | — | |
| GIT2OCR pipeline input=false2023.05 | 0.758 | — | |
| GIT2Parameters=5.1B, Vocabulary setting=Closed-vocabulary classification2022.09 | 0.751 | — | |
| GIT2Parameters=5.1B2022.05 | 0.751 | 66.6 | |
| PaLI-15BVocabulary setting=Open-vocabulary generation2022.09 | 0.732 | — | |
| LaTr2022.05 | 0.702 | 61.64 | |
| GITParameters=0.7B, Vocabulary setting=Closed-vocabulary classification2022.09 | 0.691 | — | |
| GITParameters=0.7B2022.05 | 0.691 | 59.2 | |
| PaLI-3BVocabulary setting=Open-vocabulary generation2022.09 | 0.675 | — | |
| TAP + TAGExtra Data=TextVQA2022.08 | 0.62 | 0.5353 | |
| TAP††Extra Data=TextVQA, TextCaps, OCR-CC2022.08 | 0.598 | 0.5083 | |
| TAP2022.05 | 0.598 | 50.8 | |
| TAP + TAGExtra Data=None2022.08 | 0.595 | 0.5018 | |
| LOGOSExtra Data=TextVQA2022.08 | 0.581 | 0.4863 | |
| M4C⁺ + TAGExtra Data=TextVQA2022.08 | 0.579 | 0.4869 | |
| M4C†Extra Data=TextVQA2022.08 | 0.56 | 0.466 | |
| TAPExtra Data=None2022.08 | 0.551 | 0.4529 | |
| M4C⁺ + TAGExtra Data=None2022.08 | 0.54 | 0.4452 | |
| LOGOSExtra Data=None2022.08 | 0.535 | 0.441 | |
| M4C†Extra Data=None2022.08 | 0.517 | 0.4228 | |
| SA-M4CExtra Data=None2022.08 | 0.512 | 0.4223 | |
| SA-M4C2022.05 | 0.512 | 42.2 | |
| LaAP-NetExtra Data=None2022.08 | 0.497 | 0.3974 | |
| LaAP-Net2022.05 | 0.497 | 39.7 | |
| M4C2022.05 | 0.472 | 38.1 | |
| GITLParameters=0.3B2022.05 | 0.446 | 32.3 | |
| GITBParameters=0.1B2022.05 | 0.207 | 14.7 |