Chart Question Answering on ChartQA (ChartQA)
88.12ChartQA ScoreBF16
Evaluation results
| Method | Links | |
|---|---|---|
| BF16Precision=BF162026.06 | 88.12 | |
| MODEQuantization=W32026.06 | 85.64 | |
| VEQ-MAQuantization=W32026.06 | 83.07 | |
| MC-MoEQuantization=W32026.06 | 82 | |
| GPTQQuantization=W32026.06 | 77.6 | |
| MODEQuantization=W22026.06 | 73.68 | |
| VEQ-MAQuantization=W22026.06 | 72.36 | |
| MC-MoEQuantization=W22026.06 | 70.92 | |
| Qwen2.5-VL-3BKV Size=2562026.05 | 70.9 | |
| LLaVA-Next-LLaMA-3-8BKV Size=7842026.05 | 69.2 | |
| LLaVA-Next-Qwen2-7BKV Size=7842026.05 | 67.1 | |
| Qwen2.5-VL-3B + InfiniPot-VKV Size=1282026.05 | 67 | |
| Cambrian-4B + Gaze attentionKV Size=72+42026.05 | 64.9 | |
| Cambrian-4B + Gaze attentionKV Size=144+42026.05 | 64.4 | |
| LLaVA-OV-7BKV Size=1962026.05 | 63 | |
| Cambrian-4B + Gaze attentionKV Size=288+42026.05 | 62.9 | |
| Cambrian-4BKV Size=5762026.05 | 60.2 | |
| Cambrian-8B-CLIP-LKV Size=5762026.05 | 59.4 | |
| BLIP-2-7BKV Size=5762026.05 | 58.8 | |
| Cambrian-4B + TokenCompre.KV Size=1442026.05 | 52.6 | |
| Cambrian-4B + TokenCompre. + Gaze attentionKV Size=54+42026.05 | 52.4 | |
| Cambrian-4B + TokenCompre. + Gaze attentionKV Size=36+42026.05 | 52.2 | |
| Qwen2.5-VL-3B + InfiniPot-VKV Size=502026.05 | 51 | |
| GPTQQuantization=W22026.06 | 40.75 | |
| SPHINX-7B2026.05 | 37.8 | |
| LLaVA-OV-7B + HERMESKV Size=1002026.05 | 36.8 | |
| LLaVA-OV-7B + HERMESKV Size=402026.05 | 25 | |
| Cambrian-8B-DINOv2-LKV Size=5762026.05 | 18.6 |