Multi-turn Dialogue on MT-Bench (MTB)
2.53Speedup FactorNo Filter
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| No FilterData retain ratio=100%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.53 | 2.77 | |
| SFDDData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.44 | 2.6 | |
| RandomData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.26 | 2.48 | |
| Top-1 ProbabilityData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.26 | 2.53 | |
| PPLData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.21 | 2.5 | |
| EntropyData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.2 | 2.51 | |
| MarginData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.19 | 2.42 | |
| Energy ScoreData retain ratio=50%, Draft generating step (gamma)=5, Decoding temperature=12026.01 | 2.19 | 2.5 |