List your company

Language Modeling on Private-domain fusion set medical, legal, and patent

2.418EW LossKALAVAI (MoE)
2.396562.541282.6862.83072Mar 24, 2026

Evaluation results

MethodLinks
KALAVAI (MoE)Scale=Pythia-410M, Seeds=32026.032.4180.10170.01780.0015
Monolithic (6k)Scale=Pythia-410M, Seeds=12026.032.462———
Best specialistScale=Pythia-410M, Seeds=32026.032.694———
Weight avg.Scale=Pythia-410M2026.032.709———
Base modelScale=Pythia-410M2026.032.954———