Continual Language Modeling on HOPE 8-domain, high-overlap non-adaptive stream 256M
9.4ForgettingAdaptive-OGP
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Adaptive-OGPRouting=decoupled2026.04 | 9.4 | 36 | 3.8 | |
| Replay 0.5%Routing=shared2026.04 | 11.6 | 37.8 | 1.6 | |
| Adam-NSCLRouting=shared2026.04 | 12.5 | 38.5 | 0.7 | |
| FOPNGRouting=shared2026.04 | 12.8 | 38.7 | 0.4 | |
| VanillaRouting=raw/raw2026.04 | 13.2 | 39 | — | |
| OGP (fixed α, no adapt)Routing=decoupled2026.04 | 14.1 | 39.3 | 0.9 |