Multimodal Understanding on MMT (Speedup Ratio, Token Length)
3.85Speedup RatioDREAM-S
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| DREAM-SModel=LLaVA-v1.6 Vicuna-13B, Temperature=02026.05 | 3.85 | 5.56 | |
| DREAMModel=LLaVA-v1.6 Vicuna-13B, Temperature=02026.05 | 3.68 | 5.58 | |
| DREAM-SModel=LLaVA-v1.6 Vicuna-13B, Temperature=12026.05 | 3.51 | 5.37 | |
| EAGLE-3Model=LLaVA-v1.6 Vicuna-13B, Temperature=02026.05 | 3.45 | 4.9 | |
| DREAMModel=LLaVA-v1.6 Vicuna-13B, Temperature=12026.05 | 3.34 | 5.38 | |
| DREAM-SModel=SmolVLM-2B, Temperature=02026.05 | 3.12 | 3.94 | |
| DREAMModel=SmolVLM-2B, Temperature=02026.05 | 3.05 | 3.97 | |
| DREAM-SModel=Pixtral-12B, Temperature=02026.05 | 3.01 | 4.41 | |
| EAGLE-3Model=SmolVLM-2B, Temperature=02026.05 | 3 | 3.94 | |
| DREAM-SModel=Pixtral-12B, Temperature=12026.05 | 2.98 | 3.93 | |
| EAGLE-2Model=SmolVLM-2B, Temperature=02026.05 | 2.96 | 3.89 | |
| DREAMModel=Pixtral-12B, Temperature=02026.05 | 2.93 | 4.52 | |
| DREAM-SModel=SmolVLM-2B, Temperature=12026.05 | 2.93 | 3.61 | |
| EAGLE-3Model=LLaVA-v1.6 Vicuna-13B, Temperature=12026.05 | 2.92 | 4.77 | |
| DREAMModel=Pixtral-12B, Temperature=12026.05 | 2.9 | 4.02 | |
| EAGLE-2Model=LLaVA-v1.6 Vicuna-13B, Temperature=02026.05 | 2.89 | 4.05 | |
| DREAMModel=SmolVLM-2B, Temperature=12026.05 | 2.88 | 3.66 | |
| EAGLE-3Model=Pixtral-12B, Temperature=02026.05 | 2.83 | 4.12 | |
| EAGLE-2Model=Pixtral-12B, Temperature=02026.05 | 2.81 | 3.95 | |
| EAGLE-3Model=Pixtral-12B, Temperature=12026.05 | 2.79 | 4.02 | |
| EAGLE-3Model=SmolVLM-2B, Temperature=12026.05 | 2.77 | 3.82 | |
| EAGLE-2Model=Pixtral-12B, Temperature=12026.05 | 2.76 | 3.81 | |
| DREAM-SModel=LLaVA-v1.6 Vicuna-7B, Temperature=02026.05 | 2.67 | 6.27 | |
| EAGLE-2Model=SmolVLM-2B, Temperature=12026.05 | 2.62 | 3.6 | |
| EAGLEModel=SmolVLM-2B, Temperature=02026.05 | 2.57 | 3.42 | |
| DREAMModel=LLaVA-v1.6 Vicuna-7B, Temperature=02026.05 | 2.52 | 6.4 | |
| DREAM-SModel=LLaVA-v1.6 Vicuna-7B, Temperature=12026.05 | 2.5 | 6.25 | |
| EAGLEModel=LLaVA-v1.6 Vicuna-13B, Temperature=02026.05 | 2.45 | 3.56 | |
| DREAMModel=LLaVA-v1.6 Vicuna-7B, Temperature=12026.05 | 2.39 | 6.29 | |
| EAGLE-3Model=LLaVA-v1.6 Vicuna-7B, Temperature=02026.05 | 2.38 | 5.72 | |
| EAGLEModel=Pixtral-12B, Temperature=02026.05 | 2.38 | 3.47 | |
| EAGLE-2Model=LLaVA-v1.6 Vicuna-13B, Temperature=12026.05 | 2.35 | 3.75 | |
| HydraModel=SmolVLM-2B, Temperature=02026.05 | 2.33 | 3.07 | |
| EAGLE-2Model=LLaVA-v1.6 Vicuna-7B, Temperature=02026.05 | 2.31 | 5.48 | |
| EAGLE-3Model=LLaVA-v1.6 Vicuna-7B, Temperature=12026.05 | 2.25 | 5.7 | |
| EAGLE-2Model=LLaVA-v1.6 Vicuna-7B, Temperature=12026.05 | 2.19 | 5.37 | |
| HydraModel=LLaVA-v1.6 Vicuna-13B, Temperature=02026.05 | 2.12 | 2.87 | |
| MedusaModel=SmolVLM-2B, Temperature=02026.05 | 2.12 | 2.71 | |
| EAGLEModel=LLaVA-v1.6 Vicuna-7B, Temperature=02026.05 | 2.1 | 5.04 | |
| MedusaModel=LLaVA-v1.6 Vicuna-13B, Temperature=02026.05 | 1.99 | 2.67 | |
| HydraModel=LLaVA-v1.6 Vicuna-7B, Temperature=02026.05 | 1.78 | 3.86 | |
| MedusaModel=LLaVA-v1.6 Vicuna-7B, Temperature=02026.05 | 1.58 | 2.88 | |
| HydraModel=Pixtral-12B, Temperature=02026.05 | 1.58 | 2.24 | |
| KangarooModel=LLaVA-v1.6 Vicuna-13B, Temperature=02026.05 | 1.43 | 1.77 | |
| MedusaModel=Pixtral-12B, Temperature=02026.05 | 1.37 | 1.81 | |
| KangarooModel=SmolVLM-2B, Temperature=12026.05 | 1.37 | 1.59 | |
| KangarooModel=LLaVA-v1.6 Vicuna-7B, Temperature=02026.05 | 1.32 | 2.11 | |
| KangarooModel=SmolVLM-2B, Temperature=02026.05 | 1.28 | 1.48 | |
| KangarooModel=Pixtral-12B, Temperature=02026.05 | 1.26 | 1.54 | |
| KangarooModel=LLaVA-v1.6 Vicuna-13B, Temperature=12026.05 | 1.23 | 1.57 | |
| KangarooModel=LLaVA-v1.6 Vicuna-7B, Temperature=12026.05 | 1.2 | 1.97 | |
| KangarooModel=Pixtral-12B, Temperature=12026.05 | 1.18 | 1.41 | |
| SPDModel=LLaVA-v1.6 Vicuna-7B, Temperature=02026.05 | 1.1 | 1.88 | |
| SPDModel=Pixtral-12B, Temperature=02026.05 | 1.08 | 1.51 | |
| SPDModel=LLaVA-v1.6 Vicuna-13B, Temperature=02026.05 | 1.07 | 1.78 | |
| SPDModel=SmolVLM-2B, Temperature=12026.05 | 1.07 | 1.47 | |
| SPDModel=SmolVLM-2B, Temperature=02026.05 | 1.02 | 1.33 | |
| SPDModel=LLaVA-v1.6 Vicuna-13B, Temperature=12026.05 | 0.88 | 1.22 | |
| SPDModel=LLaVA-v1.6 Vicuna-7B, Temperature=12026.05 | 0.83 | 1.19 | |
| SPDModel=Pixtral-12B, Temperature=12026.05 | 0.81 | 1.15 |