Language Modeling on Language
2.708Cross-Entropy LossRTRL
Evaluation Results
| Method | Links | |
|---|---|---|
| RTRLsparsity=k=42026.03 | 2.708 | |
| immediate derivatives (d=0)optimizer=Adam2026.03 | 2.716 |
Loading the SOTA2 catalog…
| Method | Links | |
|---|---|---|
| RTRLsparsity=k=42026.03 | 2.708 | |
| immediate derivatives (d=0)optimizer=Adam2026.03 | 2.716 |