Multimodal Understanding on SEED (Efficiency and Token Length)
3.61Speedup Ratio (S)DREAM-S
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DREAM-SModel=LLaVA-v1.6 Vicuna-13B, Temperature=02026.05 | 3.61 | 5.32 | |
| DREAM-SModel=LLaVA-v1.6 Vicuna-13B, Temperature=12026.05 | 3.55 | 5 | |
| DREAM-SModel=Pixtral-12B, Temperature=02026.05 | 2.73 | 3.56 | |
| DREAM-SModel=LLaVA-v1.6 Vicuna-7B, Temperature=02026.05 | 2.61 | 6.18 | |
| DREAM-SModel=Pixtral-12B, Temperature=12026.05 | 2.56 | 3.48 | |
| DREAM-SModel=LLaVA-v1.6 Vicuna-7B, Temperature=12026.05 | 2.45 | 5.92 | |
| DREAM-SModel=SmolVLM-2B, Temperature=12026.05 | 2.33 | 3.3 | |
| DREAM-SModel=SmolVLM-2B, Temperature=02026.05 | 2.28 | 3.16 |