Open Generation on WikiText-103
75DiversityGPT2-Medium + ACD
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GPT2-Medium + ACDNumber of parameters=355M, ACD=true, Contrast Layers=24 and 122023.05 | 75 | 63 | |
| GPT2-XLNumber of parameters=1.5B2023.05 | 31 | 63 | |
| GPT2-MediumNumber of parameters=355M, Exit Head=Original2023.05 | 22 | 63 |