List your company
ResearchFormerly WizWand

Multi-discipline Understanding on MMLU

75.05AccuracyPOP
20.86634.9334963.067Sep 27, 2025Oct 18, 2025Nov 9, 2025Nov 30, 2025Dec 22, 2025Jan 12, 2026Feb 3, 2026
Updated 7mo ago

Evaluation results

MethodLinks
POPBackbone=Qwen3-VL-8B-Instruct, Pruning Ratio=33.3%2026.0275.05—
Full ModelBackbone=Qwen3-VL-8B-Instruct, Pruning Ratio=0%2026.0274.95—
WandaBackbone=Qwen3-VL-8B-Instruct, Pruning Ratio=30%2026.0273.78—
Full ModelBackbone=Gemma-3-12B-It, Pruning Ratio=0%2026.0271.46—
POPBackbone=Gemma-3-12B-It, Pruning Ratio=33.3%2026.0271.37—
WandaBackbone=Gemma-3-12B-It, Pruning Ratio=30%2026.0269.7—
Full ModelBackbone=Llama-3.1-8B-Instruct, Pruning Ratio=0%2026.0268.33—
POPBackbone=Llama-3.1-8B-Instruct, Pruning Ratio=31.25%2026.0267.43—
WandaBackbone=Llama-3.1-8B-Instruct, Pruning Ratio=30%2026.0265.87—
ShortGPTBackbone=Llama-3.1-8B-Instruct, Pruning Ratio=25%2026.0265.8—
JETBackbone=DS-Qwen-7B2025.0963.9860
Laser-DEBackbone=DS-Qwen-7B2025.0963.41,027
Laser-DBackbone=DS-Qwen-7B2025.0962.31,059
SFTBackbone=DS-Qwen-7B2025.0960.21,044
BaseBackbone=DS-Qwen-7B2025.0960.11,022
DPOBackbone=DS-Qwen-7B2025.0960.1947
DAPOBackbone=DS-Qwen-7B2025.0958.9907
AdaptThinkBackbone=DS-Qwen-7B2025.0957.3840
LCR1Backbone=DS-Qwen-7B2025.0956.5611
Laser-DBackbone=DS-Qwen-1.5B2025.0947.21,143
DAPOBackbone=DS-Qwen-1.5B2025.0946.5856
Laser-DEBackbone=DS-Qwen-1.5B2025.0946.21,217
SFTBackbone=DS-Qwen-1.5B2025.0944.71,122
JETBackbone=DS-Qwen-1.5B2025.0944.6715
DPOBackbone=DS-Qwen-1.5B2025.0944.51,143
AdaptThinkBackbone=DS-Qwen-1.5B2025.0944.51,224
BaseBackbone=DS-Qwen-1.5B2025.0943.81,306
LCR1Backbone=DS-Qwen-1.5B2025.0942.7744
SliceGPTBackbone=Qwen3-VL-8B-Instruct, Pruning Ratio=25%2026.0239.16—
SliceGPTBackbone=Llama-3.1-8B-Instruct, Pruning Ratio=25%2026.0234.97—
ShortGPTBackbone=Qwen3-VL-8B-Instruct, Pruning Ratio=25%2026.0233.85—
ShortGPTBackbone=Gemma-3-12B-It, Pruning Ratio=25%2026.0223.81—
SliceGPTBackbone=Gemma-3-12B-It, Pruning Ratio=25%2026.0222.95—