ResearchBenchmarksLanguage Understanding and Reasoning on Combined (GSM8k, MATH500, MAWPS, SVAMP, AQuA, GLUE, CSQA, OBQA)Follow72.94Average ScoreMoSLoRA46.99253.728560.46567.2015Feb 16, 2026Evaluation ResultsMethodMethodLinksAverage ScoreMoSLoRABackbone=Qwen2.5-3BBackbone=Qwen2.5-3B2026.0272.94HypLoRABackbone=Qwen2.5-3BBackbone=Qwen2.5-3B2026.0271.03HydraLoRABackbone=Qwen2.5-3BBackbone=Qwen2.5-3B2026.0270.69LoRABackbone=Qwen2.5-3BBackbone=Qwen2.5-3B2026.0268.81BaseBackbone=Qwen2.5-3BBackbone=Qwen2.5-3B2026.0247.99