Multi-task Language Understanding on MMLU-pro (Performance, TPS, FLOPs)
35.86TPSDream Base + dLLM-Cache
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Dream Base + dLLM-CacheConfiguration=+ dLLM-Cache2025.05 | 35.86 | 2.3 | 2.89 | 2.74 | 23.86 | |
| Dream Instruct + dLLM-CacheConfiguration=+ dLLM-Cache2025.05 | 23.98 | 1.56 | 4.77 | 1.67 | 43.96 | |
| Dream BaseConfiguration=Dream Base2025.05 | 15.61 | 1 | 7.92 | 1 | 24.13 | |
| Dream InstructConfiguration=Dream Instruct2025.05 | 15.4 | 1 | 7.98 | 1 | 43.79 |