List your company
ResearchFormerly WizWand

Language Modeling on MiniPile (train)

30.87Training PerplexityLiMuon
28.431244.893161.35577.8169Sep 18, 2025
Updated 5mo ago

Evaluation results

MethodLinks
LiMuonMemory (GB)=55.15, rank=full rank2025.0930.87
LiMuonMemory (GB)=54.21, rank=162025.0933.43
Muon++Memory (GB)=54.302025.0935.16
MuonMemory (GB)=54.142025.0935.52
LiMuonMemory (GB)=52.55, rank=82025.0938.86
SUMOMemory (GB)=52.732025.0941.26
LiMuonMemory (GB)=50.86, rank=42025.0941.46
LionMemory (GB)=54.082025.0948.42
AdamWMemory (GB)=55.262025.0957.97
AdamMemory (GB)=55.242025.0991.84