Inference Performance on CNN/DM (Summarization)
2.3SpeedupNo Filter
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| No FilterData retain ratio=100%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.3 | 2.58 | |
| SFDDData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.14 | 2.38 | |
| PPLData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.01 | 2.33 | |
| RandomData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 1.99 | 2.31 | |
| Top-1 ProbabilityData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 1.99 | 2.32 | |
| Energy ScoreData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 1.99 | 2.33 | |
| EntropyData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 1.95 | 2.32 | |
| MarginData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 1.92 | 2.27 |