Multi-turn Dialogue on MT-Bench (Acceptance Length τ and Speedup Ratio)
5.78Acceptance Length (τ)PPOW
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PPOWModel=Q3-32B, Temperature=0.02026.05 | 5.78 | 3.54 | |
| PPOWModel=Q3-8B, Temperature=0.02026.05 | 5.58 | 3.02 | |
| EAGLE-3Model=L31-8B, Temperature=0.02026.05 | 5.53 | 2.91 | |
| PPOWModel=L31-8B, Temperature=0.02026.05 | 5.47 | 2.72 | |
| PPOWModel=L33-70B, Temperature=0.02026.05 | 5.45 | 3.73 | |
| EAGLE-3Model=Q3-32B, Temperature=0.02026.05 | 5.25 | 3.47 | |
| GRIFFINModel=L31-8B, Temperature=0.02026.05 | 5.14 | 2.58 | |
| PPOWModel=L33-70B, Temperature=1.02026.05 | 5.14 | 3.52 | |
| EAGLE-3Model=L33-70B, Temperature=0.02026.05 | 5.12 | 3.63 | |
| GRIFFINModel=L33-70B, Temperature=0.02026.05 | 5.08 | 3.6 | |
| EAGLE-3Model=Q3-8B, Temperature=0.02026.05 | 4.95 | 2.64 | |
| PPOWModel=Q3-32B, Temperature=1.02026.05 | 4.95 | 2.81 | |
| EAGLE-3Model=L33-70B, Temperature=1.02026.05 | 4.82 | 3.4 | |
| PPOWModel=Q3-8B, Temperature=1.02026.05 | 4.72 | 2.82 | |
| GRIFFINModel=L33-70B, Temperature=1.02026.05 | 4.7 | 3.38 | |
| EAGLE-3Model=Q3-32B, Temperature=1.02026.05 | 4.51 | 2.6 | |
| EAGLE-3Model=L31-8B, Temperature=1.02026.05 | 4.17 | 2.35 | |
| PPOWModel=L31-8B, Temperature=1.02026.05 | 4.12 | 2.29 | |
| GRIFFINModel=L31-8B, Temperature=1.02026.05 | 4.03 | 2.24 | |
| EAGLE-3Model=Q3-8B, Temperature=1.02026.05 | 4 | 2.41 |