Visual Question Answering on TallyQA simple
86.3AccuracySMoLA-PaLI-X_FT (Specialist)
Evaluation results
| Method | Links | |
|---|---|---|
| SMoLA-PaLI-X_FT (Specialist)Base model=PaLI-X, Per-task LoRA tuning=true, LoRA rank=42023.12 | 86.3 | |
| PaLI-XParameters=55B, Fine-tuning=per-task, OCR_pipeline=without2023.05 | 86 | |
| PaLI-XParameters=55B2023.10 | 86 | |
| PaLI-XBase model=PaLI-X2023.12 | 86 | |
| SOTA [7]2023.12 | 86 | |
| PaLI-3Parameters=5B2023.10 | 83.3 | |
| PaLIParameters=17B, Fine-tuning=per-task, OCR_pipeline=without2023.05 | 81.7 | |
| PaLI-17BParameters=17B2023.10 | 81.7 | |
| MoVieFine-tuning=per-task, OCR_pipeline=without2023.05 | 74.9 | |
| MoVie2023.10 | 74.9 |