Mathematical Reasoning on GSM8K (Speedup & Average Acceptance Length)
2.71SpeedupNo Filter
Evaluation results
| Method | Links | ||
|---|---|---|---|
| No FilterData retain ratio=100%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.71 | 3.28 | |
| SFDDData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.69 | 2.95 | |
| Top-1 ProbabilityData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.49 | 2.84 | |
| Energy ScoreData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.49 | 2.87 | |
| MarginData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.45 | 2.85 | |
| RandomData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.43 | 2.85 | |
| EntropyData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.43 | 2.85 | |
| PPLData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.36 | 2.79 |