ResearchBenchmarksMulti-task Language Understanding on MMLU (MU)Multi-task Language Understanding on MMLU (MU)Follow69.5MMLU AccuracyTILEQ_s40.79648.24855.763.152May 10, 2026Evaluation resultsMethodMethodLinksMMLU AccuracyTILEQ_sModel=Mixtral-8x7B, Av...Model=Mixtral-8x7B, Avg.bit=3.162026.0569.5MiLoModel=Mixtral-8x7B, Av...Model=Mixtral-8x7B, Avg.bit=3.42026.0567.1TILEQ_sModel=Deepseek-MoE, Av...Model=Deepseek-MoE, Avg.bit=3.162026.0544.3MiLoModel=Deepseek-MoE, Av...Model=Deepseek-MoE, Avg.bit=3.42026.0541.9