Science Question Answering on ScienceQA (Speedup and Token Length Metrics)
3.41Speedup RatioDREAM-S
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DREAM-SModel=LLaVA-v1.6 Vicuna-13B, Temperature=02026.05 | 3.41 | 5.19 | |
| DREAM-SModel=LLaVA-v1.6 Vicuna-13B, Temperature=12026.05 | 3.38 | 5.88 | |
| DREAM-SModel=Pixtral-12B, Temperature=02026.05 | 3.09 | 3.93 | |
| DREAM-SModel=Pixtral-12B, Temperature=12026.05 | 2.99 | 3.79 | |
| DREAM-SModel=SmolVLM-2B, Temperature=12026.05 | 2.96 | 3.67 | |
| DREAM-SModel=SmolVLM-2B, Temperature=02026.05 | 2.91 | 3.57 | |
| DREAM-SModel=LLaVA-v1.6 Vicuna-7B, Temperature=02026.05 | 2.45 | 5.71 | |
| DREAM-SModel=LLaVA-v1.6 Vicuna-7B, Temperature=12026.05 | 2.33 | 5.56 |