Visual Question Answering on Chart VQA (test)
73.8AccuracySMoLA-PaLI-XFT
Evaluation results
| Method | Links | |
|---|---|---|
| SMoLA-PaLI-XFTOCR pipeline input=true, Model Category=Generalist, Backbone=PaLI-X2023.12 | 73.8 | |
| PaLI-X (Specialist)OCR pipeline input=true, Model Category=Specialist, Reference Citation=[7]2023.12 | 72.3 | |
| SMoLA-PaLI-XFTOCR pipeline input=false, Model Category=Generalist, Backbone=PaLI-X2023.12 | 71.3 | |
| PaLI-X (Specialist)OCR pipeline input=false, Model Category=Specialist, Reference Citation=[7]2023.12 | 70.9 | |
| SMoLA-PaLI-3FTOCR pipeline input=false, Model Category=Generalist, Backbone=PaLI-32023.12 | 68.9 | |
| SMoLA-PaLI-3FTOCR pipeline input=true, Model Category=Generalist, Backbone=PaLI-32023.12 | 68.9 | |
| Qwen-VLOCR pipeline input=false, Model Category=Generalist2023.12 | 65.7 | |
| mPLUG-DocOwlOCR pipeline input=false, Model Category=Generalist2023.12 | 57.4 |