Mathematical Reasoning on MathVista (Speedup Ratio and Token Length)
2.62Speedup RatioDREAM-S
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| DREAM-SModel=LLaVA-v1.6 Vicuna-13B, Temperature=02026.05 | 2.62 | 4.11 | |
| DREAM-SModel=Pixtral-12B, Temperature=02026.05 | 2.42 | 3.34 | |
| DREAM-SModel=LLaVA-v1.6 Vicuna-13B, Temperature=12026.05 | 2.38 | 3.99 | |
| DREAM-SModel=Pixtral-12B, Temperature=12026.05 | 2.22 | 3.22 | |
| DREAM-SModel=LLaVA-v1.6 Vicuna-7B, Temperature=02026.05 | 2.2 | 5.3 | |
| DREAM-SModel=LLaVA-v1.6 Vicuna-7B, Temperature=12026.05 | 2.09 | 5.13 | |
| DREAM-SModel=SmolVLM-2B, Temperature=02026.05 | 2.06 | 2.82 | |
| DREAM-SModel=SmolVLM-2B, Temperature=12026.05 | 2.01 | 2.66 |