Scene Text Visual Question Answering on ST-VQA (test)
0.799ANLSPaLI-17B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PaLI-17BVocabulary setting=Open-vocabulary generation2022.09 | 0.799 | — | |
| PaLI-15BVocabulary setting=Open-vocabulary generation2022.09 | 0.765 | — | |
| GIT2Parameters=5.1B, Vocabulary setting=Closed-vocabulary classification2022.09 | 0.758 | — | |
| PaLI-3BVocabulary setting=Open-vocabulary generation2022.09 | 0.697 | — | |
| GITParameters=0.7B, Vocabulary setting=Closed-vocabulary classification2022.09 | 0.696 | — | |
| TAP + TAGExtra Data=TextVQA2022.08 | 0.602 | — | |
| TAP††Extra Data=TextVQA, TextCaps, OCR-CC2022.08 | 0.597 | — | |
| TAP + TAGExtra Data=None2022.08 | 0.586 | — | |
| LOGOSExtra Data=TextVQA2022.08 | 0.579 | — | |
| M4C⁺ + TAGExtra Data=TextVQA2022.08 | 0.571 | — | |
| M4C†Extra Data=TextVQA2022.08 | 0.552 | — | |
| SSBaselineExtra Data=TextVQA2022.08 | 0.55 | — | |
| TAPExtra Data=None2022.08 | 0.543 | — | |
| M4C⁺ + TAGExtra Data=None2022.08 | 0.529 | — | |
| LOGOSExtra Data=None2022.08 | 0.522 | — | |
| M4C†Extra Data=None2022.08 | 0.517 | — | |
| SSBaselineExtra Data=None2022.08 | 0.509 | — | |
| SA-M4CExtra Data=None2022.08 | 0.504 | — | |
| SMAExtra Data=None2022.08 | 0.486 | — | |
| LaAP-NetExtra Data=None2022.08 | 0.485 | — | |
| CRNExtra Data=None2022.08 | 0.483 | — | |
| DocPediaResolution=2560x2560, In-house data=false2024.03 | — | 45.5 | |
| InfiMM-HDResolution=dynamic, In-house data=false2024.03 | — | 67 | |
| MonkeyResolution=1344x768, In-house data=true2024.03 | — | 67.7 | |
| PaLI-3 (Specialist)OCR pipeline input=false, Model Category=Specialist, Reference Citation=[8]2023.12 | — | 84.1 | |
| PaLI-3 (Specialist)OCR pipeline input=true, Model Category=Specialist, Reference Citation=[8]2023.12 | — | 85.7 | |
| SMoLA-PaLI-3FTOCR pipeline input=false, Model Category=Generalist, Backbone=PaLI-32023.12 | — | 83.8 | |
| SMoLA-PaLI-3FTOCR pipeline input=true, Model Category=Generalist, Backbone=PaLI-32023.12 | — | 85.9 | |
| SMoLA-PaLI-XFTOCR pipeline input=false, Model Category=Generalist, Backbone=PaLI-X2023.12 | — | 78.9 | |
| SMoLA-PaLI-XFTOCR pipeline input=true, Model Category=Generalist, Backbone=PaLI-X2023.12 | — | 86 | |
| UniDocResolution=224x224, In-house data=false2024.03 | — | 30.8 |