Averaged Performance across Five Downstream Tasks on Average Overall
2.49SpeedupNo Filter
Evaluation results
| Method | Links | ||
|---|---|---|---|
| No FilterData retain ratio=100%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.49 | 2.78 | |
| SFDDData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.41 | 2.56 | |
| Top-1 ProbabilityData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.23 | 2.49 | |
| Energy ScoreData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.21 | 2.49 | |
| RandomData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.2 | 2.46 | |
| EntropyData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.2 | 2.49 | |
| PPLData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.2 | 2.48 | |
| MarginData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.15 | 2.4 |