Efficiency Metrics on Big-Bench Hard Reasoning (BBH)
29.61Throughput (TPS)Dream Base + dLLM-Cache
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Dream Base + dLLM-CacheConfiguration=+ dLLM-Cache2025.05 | 29.61 | 4.09 | 3.35 | 5.15 | 51.66 | |
| Dream Instruct + dLLM-CacheConfiguration=+ dLLM-Cache2025.05 | 22.31 | 3.2 | 4.82 | 3.71 | 57.07 | |
| Dream BaseConfiguration=Dream Base2025.05 | 7.24 | 1 | 17.25 | 1 | 52.25 | |
| Dream InstructConfiguration=Dream Instruct2025.05 | 6.98 | 1 | 17.9 | 1 | 57.07 |