List your company

Zero-shot Evaluation on ARC, BoolQ, HellaSwag, LAMBADA, and MMLU

0.354ARC-CMuon-32
0.1980.23850.2790.3195Sep 27, 2025

Evaluation results

MethodLinks
Muon-32Model size=XXL2025.090.3540.7130.6180.4280.4240.2610.466
Muon-8L/AdamW-32Model size=XXL2025.090.3520.7070.6180.4280.4220.2560.464
Muon-8L/AdamW-8DModel size=XXL2025.090.3470.7060.6250.4250.4180.260.463
Muon-8L/AdamW-32Model size=XL2025.090.2980.6510.6030.3810.3730.2530.427
Muon-32Model size=XL2025.090.2960.6530.6070.3820.3760.2550.428
Muon-8L/AdamW-8DModel size=XL2025.090.2930.6490.5860.3790.3680.2540.422
Muon-32Model size=Large2025.090.2810.620.6060.3550.3420.250.409
Muon-8L/AdamW-32Model size=Large2025.090.2780.6260.610.3560.3380.2510.41
Muon-8L/AdamW-8DModel size=Large2025.090.2720.6280.6110.3550.3350.2450.408
Muon-8L/AdamW-32Model size=Medium2025.090.2470.5630.6130.3150.2740.2320.374
Muon-32Model size=Medium2025.090.2360.5640.6060.3160.2720.2310.371
Muon-8L/AdamW-8DModel size=Medium2025.090.2350.5590.5950.3140.2720.230.368
Muon-8L/AdamW-32Model size=Small2025.090.2110.5050.5740.2850.2020.230.335
Muon-8L/AdamW-8DModel size=Small2025.090.2050.5060.580.2830.2020.230.334
Muon-32Model size=Small2025.090.2040.5030.5710.2850.2030.230.332