Chart Question Answering on ChartQA (Speedup and Token Length)
2.67Speedup Ratio (S)DREAM-S
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| DREAM-SModel=LLaVA-v1.6 Vicuna-13B, Temperature=02026.05 | 2.67 | 4.17 | |
| DREAM-SModel=LLaVA-v1.6 Vicuna-13B, Temperature=12026.05 | 2.59 | 4.09 | |
| DREAM-SModel=Pixtral-12B, Temperature=02026.05 | 2.4 | 3.42 | |
| DREAM-SModel=Pixtral-12B, Temperature=12026.05 | 2.26 | 3.09 | |
| DREAM-SModel=LLaVA-v1.6 Vicuna-7B, Temperature=02026.05 | 2.04 | 4.39 | |
| DREAM-SModel=LLaVA-v1.6 Vicuna-7B, Temperature=12026.05 | 1.97 | 4.22 | |
| DREAM-SModel=SmolVLM-2B, Temperature=12026.05 | 1.81 | 2.48 | |
| DREAM-SModel=SmolVLM-2B, Temperature=02026.05 | 1.64 | 2.28 |