List your company
ResearchFormerly WizWand

Zero-shot Evaluation on MMLU, GSM, and M500 (test)

68.3Avg AccuracyGeneric TB-Coverage
38.34846.12453.961.676Jul 2, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Generic TB-CoverageModel=DeepSeek-MoE-16B-Base, Retain Ratio=75%2026.0768.330.900.6
Paper ExpertSparsityModel=DeepSeek-MoE-16B-Base, Retain Ratio=75%2026.0767.831.400.4
Generic TB-CoverageModel=Qwen1.5-MoE-A2.7B, Retain Ratio=75%2026.0766.252.80.20.2
Paper ExpertSparsityModel=Qwen1.5-MoE-A2.7B, Retain Ratio=75%2026.0765.554.800.2
Original REAPModel=DeepSeek-MoE-16B-Base, Retain Ratio=75%2026.0764.93400
RandomModel=Qwen1.5-MoE-A2.7B, Retain Ratio=75%2026.0764.551.600.3
Original REAPModel=Qwen1.5-MoE-A2.7B, Retain Ratio=75%2026.0762.951.900.2
Generic TB-CoverageModel=DeepSeek-MoE-16B-Base, Retain Ratio=50%2026.0760.624.200.6
Generic TB-CoverageModel=Qwen1.5-MoE-A2.7B, Retain Ratio=50%2026.0759.836.900.4
Paper ExpertSparsityModel=DeepSeek-MoE-16B-Base, Retain Ratio=50%2026.0757.126.401
RandomModel=DeepSeek-MoE-16B-Base, Retain Ratio=75%2026.0756.82600.6
Original REAPModel=Qwen1.5-MoE-A2.7B, Retain Ratio=50%2026.0755.240.600.2
Original REAPModel=DeepSeek-MoE-16B-Base, Retain Ratio=50%2026.0754.228.700.8
RandomModel=Qwen1.5-MoE-A2.7B, Retain Ratio=50%2026.0753.531.500.2
Paper ExpertSparsityModel=Qwen1.5-MoE-A2.7B, Retain Ratio=50%2026.0751.932.500
RandomModel=DeepSeek-MoE-16B-Base, Retain Ratio=50%2026.0748.824.400.5
Generic TB-CoverageModel=Qwen1.5-MoE-A2.7B, Retain Ratio=25%2026.0744.823.400
Generic TB-CoverageModel=DeepSeek-MoE-16B-Base, Retain Ratio=25%2026.0744.823.200
Original REAPModel=Qwen1.5-MoE-A2.7B, Retain Ratio=25%2026.0743.824.700
RandomModel=Qwen1.5-MoE-A2.7B, Retain Ratio=25%2026.0741.724——
Paper ExpertSparsityModel=Qwen1.5-MoE-A2.7B, Retain Ratio=25%2026.0740.723.300
Paper ExpertSparsityModel=DeepSeek-MoE-16B-Base, Retain Ratio=25%2026.0740.42400
RandomModel=DeepSeek-MoE-16B-Base, Retain Ratio=25%2026.0740.324.3——
Original REAPModel=DeepSeek-MoE-16B-Base, Retain Ratio=25%2026.0739.523.800.6