Chart Question Answering on ChartQA augmented (test)
91.36Relaxed AccuracyMATCHA + LAMENDA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MATCHA + LAMENDAparams=282M, resolution=4096 tokens2024.03 | 91.36 | 81.84 | |
| DEPLOT + FlanPaLM + Codexparams=540B2024.03 | 91 | — | |
| MATCHAparams=282M, resolution=4096 tokens2024.03 | 90.2 | — | |
| MATCHAparams=282M, resolution=4096 tokens, implementation=re-implemented2024.03 | 89.68 | 80.32 | |
| MATCHA + LAMENDAparams=282M, resolution=1024 tokens2024.03 | 88 | 78.64 | |
| Pix2Structparams=282M, resolution=4096 tokens, implementation=re-implemented2024.03 | 84.48 | 76.24 | |
| Pix2Struct + LAMENDAparams=282M, resolution=4096 tokens2024.03 | 81.98 | 71.56 | |
| Pix2Structparams=282M, resolution=4096 tokens2024.03 | 81.6 | — | |
| Pix2Struct + LAMENDAparams=282M, resolution=1024 tokens2024.03 | 79.79 | 68.85 |