Spoken Language Modeling on SpeechCrawl (val)
0.0047LossCD SLM
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| CD SLMModel size=16B, CFG=22026.04 | 0.0047 | 4.7207 | 5.4809 | 5.9278 | 3.5674 | 4.1632 | 3.8542 | 0.1811 | |
| CD SLMModel size=16B, CFG=42026.04 | 0.0047 | 4.7712 | 5.2965 | 5.7659 | 3.5349 | 3.9617 | 3.4789 | 0.177 | |
| CD SLM (best scaling law trial)Compute (C)=10^21, CFG=22026.04 | 0.0061 | 4.5767 | 5.1093 | 5.6893 | 3.5597 | 3.968 | 3.5468 | 0.2253 | |
| CD SLM (best scaling law trial)Compute (C)=10^21, CFG=42026.04 | 0.0061 | 4.5545 | 5.0746 | 5.6356 | 3.5511 | 3.9571 | 3.5312 | 0.2096 |