Chart Question Answering on PlotQA (test)
92.89Relaxed Accuracy (avg)MATCHA + LAMENDA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MATCHA + LAMENDAResolution (image tokens)=4096, Data Augmentation=LAMENDA2024.03 | 92.89 | 93.94 | 91.84 | |
| MATCHAResolution (image tokens)=4096, Status=re-implemented2024.03 | 91.97 | 92.64 | 91.3 | |
| MATCHAResolution (image tokens)=40962024.03 | 91.5 | 92.3 | 90.7 | |
| MATCHA + LAMENDAResolution (image tokens)=1024, Data Augmentation=LAMENDA2024.03 | 78.41 | 78.44 | 78.38 | |
| MATCHAResolution (image tokens)=1024, Status=re-implemented2024.03 | 74.95 | 73.88 | 76.02 | |
| Pix2Struct2024.03 | 72.5 | 73.2 | 71.9 | |
| DEPLOT+FlanPaLM+Codex2024.03 | 66.6 | 62.2 | 71 | |
| VL-T5-OCR2024.03 | 65.96 | 75.9 | 56.02 | |
| VisionTapas-OCR2024.03 | 53.9 | 65.3 | 42.5 |