List your company
ResearchFormerly WizWand

SFT Generalization on Tulu3 SFT (Expanded)

65.77SFT ScoreDeltaMoE
53.373256.591659.8163.0284May 18, 2026
Updated 5mo ago

Evaluation results

MethodLinks
DeltaMoEBase Model=Qwen2.5-7B, Alignment Delta=Tulu3, Comparison Category=Baselines w/ Matched Parameters2026.0565.77
LLaMA-ProBase Model=Qwen2.5-7B, Alignment Delta=Tulu3, Comparison Category=Baselines w/ Matched Parameters2026.0564.97
MoLABase Model=Qwen2.5-7B, Alignment Delta=Tulu3, Comparison Category=Baselines w/ Matched Parameters2026.0564.25
Dense-FT-DeltaBase Model=Qwen2.5-7B, Alignment Delta=Tulu3, Comparison Category=Baselines w/ Same CPT Data2026.0562.25
Dense-FT-AvgBase Model=Qwen2.5-7B, Alignment Delta=Tulu3, Comparison Category=Baselines w/ Same CPT Data2026.0561.55
Dense-FT-Delta-2FLOPsBase Model=Qwen2.5-7B, Alignment Delta=Tulu3, Comparison Category=Baselines w/ Matched FLOPs (2x CPT Data)2026.0559.64
Dense-FT-Avg-2FLOPsBase Model=Qwen2.5-7B, Alignment Delta=Tulu3, Comparison Category=Baselines w/ Matched FLOPs (2x CPT Data)2026.0558.32
Qwen-7B + Tulu-DeltaBase Model=Qwen2.5-7B, Alignment Delta=Tulu32026.0553.85