Language Modeling on Text8 word-level (val)
81.64PerplexityPRPN
Evaluation results
| Method | Links | |
|---|---|---|
| PRPN2017.11 | 81.64 | |
| LSTM + continuous cache pointercache pointer=continuous2017.11 | 99.9 | |
| MemN2N# of hidden=500, # of hops=7, memory size=1002015.03 | 118 | |
| LSTM-1024hidden units=10242017.11 | 121 | |
| LSTM# of hidden=5002015.03 | 122 | |
| MemN2N# of hidden=500, # of hops=5, memory size=1002015.03 | 123 | |
| MemN2N# of hidden=500, # of hops=6, memory size=1502015.03 | 123 | |
| MemN2N# of hidden=500, # of hops=6, memory size=1002015.03 | 124 | |
| MemN2N# of hidden=500, # of hops=6, memory size=1252015.03 | 125 | |
| MemN2N# of hidden=500, # of hops=6, memory size=752015.03 | 126 | |
| MemN2N# of hidden=500, # of hops=4, memory size=1002015.03 | 129 | |
| MemN2N# of hidden=500, # of hops=6, memory size=252015.03 | 131 | |
| MemN2N# of hidden=500, # of hops=6, memory size=502015.03 | 132 | |
| MemN2N# of hidden=500, # of hops=3, memory size=1002015.03 | 142 | |
| MemNN2017.11 | 147 | |
| MemN2N# of hidden=500, # of hops=2, memory size=1002015.03 | 152 | |
| LSTM-500hidden units=5002017.11 | 156 | |
| SCRNN2017.11 | 161 |