Language Modeling on Language
2.708Cross-Entropy LossRTRL
Evaluation results
| Method | Links | |
|---|---|---|
| RTRLsparsity=k=42026.03 | 2.708 | |
| immediate derivatives (d=0)optimizer=Adam2026.03 | 2.716 |
| Method | Links | |
|---|---|---|
| RTRLsparsity=k=42026.03 | 2.708 | |
| immediate derivatives (d=0)optimizer=Adam2026.03 | 2.716 |