ResearchBenchmarksLanguage Modeling on C4 (Accuracy)Follow77.12AccuracyB15865.4268.457571.49574.5325May 9, 2026Evaluation ResultsMethodMethodLinksAccuracyB158Size=1.0BSize=1.0B2026.0577.12+LGRSize=1.0BSize=1.0B2026.0576.15BF16Size=1.0BSize=1.0B2026.0572.43B158Size=1.7BSize=1.7B2026.0570.87+LGRSize=0.4BSize=0.4B2026.0569.44+LGRSize=1.7BSize=1.7B2026.0568.22B158Size=0.4BSize=0.4B2026.0568.11BF16Size=0.4BSize=0.4B2026.0567.76BF16Size=1.7BSize=1.7B2026.0565.87