List your company

In-context Learning on Fineweb-Edu 16.8B tokens

36.86ARC-c AccuracySpectra-AdEMAMix
33.313634.234335.15536.0757Mar 15, 2026

Evaluation results

MethodLinks
Spectra-AdEMAMixModel size=820M, Protocol=5-shot, Pre-training tokens=16.8B, Harness=lm-evaluation-harness2026.0336.8668.8153.9469.4847.0953.4336.428.2689.426.2350.99
D-MuonModel size=820M, Protocol=5-shot, Pre-training tokens=16.8B, Harness=lm-evaluation-harness2026.0336.667.4753.7369.3146.6952.7234.628.8490.925.0850.59
Spectra-AdamWModel size=820M, Protocol=5-shot, Pre-training tokens=16.8B, Harness=lm-evaluation-harness2026.0335.6766.9655.4168.8246.5752.0936.426.7489.225.1450.3
Spectra-SignumModel size=820M, Protocol=5-shot, Pre-training tokens=16.8B, Harness=lm-evaluation-harness2026.0335.5868.8158.170.4647.0454.4635.629.3690.326.4451.62
AdEMAMixModel size=820M, Protocol=5-shot, Pre-training tokens=16.8B, Harness=lm-evaluation-harness2026.0335.4165.9543.4370.0846.4353.234.428.5188.324.8449.05
MarsModel size=820M, Protocol=5-shot, Pre-training tokens=16.8B, Harness=lm-evaluation-harness2026.0334.9867.857.2570.0846.8752.1734.229.3889.625.3750.77
SignumModel size=820M, Protocol=5-shot, Pre-training tokens=16.8B, Harness=lm-evaluation-harness2026.0334.5665.6656.0269.6445.0152.2534.228.0487.325.7549.84
AdamWModel size=820M, Protocol=5-shot, Pre-training tokens=16.8B, Harness=lm-evaluation-harness2026.0333.4566.8456.0969.2145.6550.9935.225.5490.823.8649.76