Mathematical Reasoning on GSM8K 5-shot v1.0 (test)
73.7AccuracyThreshold
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ThresholdModel=Dream-v0-Base-7B, PrefixCache=Enabled, Block size=32, Hardware=H100, Len.=2562026.06 | 73.7 | 51.1 | 202,862 | 1.66 | |
| ThresholdModel=Dream-v0-Base-7B, PrefixCache=Enabled, Block size=32, Hardware=H100, Len.=5122026.06 | 73.7 | 57.2 | 355,339 | 1.9 | |
| FactorModel=Dream-v0-Base-7B, PrefixCache=Enabled, Block size=32, Hardware=H100, Len.=5122026.06 | 73.1 | 70.5 | 302,274 | 2.23 | |
| FrechetModel=Dream-v0-Base-7B, PrefixCache=Enabled, Block size=32, Hardware=H100, Len.=5122026.06 | 72.7 | 70.7 | 293,029 | 2.3 | |
| FactorModel=Dream-v0-Base-7B, PrefixCache=Enabled, Block size=32, Hardware=H100, Len.=2562026.06 | 72 | 63.1 | 176,073 | 1.89 | |
| FrechetModel=Dream-v0-Base-7B, PrefixCache=Enabled, Block size=32, Hardware=H100, Len.=2562026.06 | 72 | 63.8 | 171,925 | 1.96 |