Autoencoding on BookCorpus
90.58BLEUTextEconomizer
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| TextEconomizer#Params.=86M, Token%=100%2026.06 | 90.58 | 97.92 | 93.89 | 87.11 | 93.86 | 91.32 | 5.24 | 1.12 | |
| TextEconomizer#Params.=86M, Token%=50%2026.06 | 90.3 | 97.88 | 93.71 | 86.75 | 93.66 | 91.14 | 5.33 | 3.1 | |
| LLaMAFormer#Params.=50M, Token%=50%2026.06 | 89.92 | 97.82 | 93.52 | 86.37 | 93.48 | 90.96 | 5.31 | 3.1 | |
| Autoencoder#Params.=67M, Token%=100%2026.06 | 88.81 | 97.61 | 92.9 | 85.15 | 92.86 | 90.12 | 12.33 | 25 | |
| T5-Small#Params.=70M, Token%=100%2026.06 | 73.37 | 97.04 | 92.16 | 88.47 | 92.15 | 75.28 | 1.03 | — |