List your company
ResearchFormerly WizWand

Math Reasoning on MMLU-Pro

42.48EM ScoreW/O (FP16)
8.555217.362626.1734.9774Nov 9, 2025
Updated 5mo ago

Evaluation results

MethodLinks
W/O (FP16)Backbone=Gemma-2-9B2025.1142.4817.21
TAQ-KLBackbone=Gemma-2-9B2025.1142.486.76
AWQBackbone=Gemma-2-9B2025.1141.65.74
TAQ-ISBackbone=Gemma-2-9B2025.1141.66.76
W/O (FP16)Backbone=Qwen2-7B2025.1141.0614.19
GPTQBackbone=Gemma-2-9B2025.1140.635.75
SliM-LLMBackbone=Gemma-2-9B2025.1139.895.83
TAQ-OBackbone=Gemma-2-9B2025.1139.49.02
TAQ-KLBackbone=Qwen2-7B2025.1139.115.95
TAQ-OBackbone=Qwen2-7B2025.1138.579.05
SliM-LLMBackbone=Qwen2-7B2025.1138.485.83
TAQ-ISBackbone=Qwen2-7B2025.1137.995.95
W/O (FP16)Backbone=Qwen2.5-3B2025.1137.55.75
TAQ-KLBackbone=Qwen2.5-7B2025.1135.355.95
TAQ-ISBackbone=Qwen2.5-7B2025.1133.355.95
W/O (FP16)Backbone=Qwen2.5-7B2025.1133.214.19
TAQ-OBackbone=Qwen2.5-3B2025.1133.013.2
TAQ-OBackbone=Qwen2.5-7B2025.1132.139.05
SliM-LLMBackbone=Qwen2.5-7B2025.1131.015.83
SliM-LLMBackbone=Qwen2.5-3B2025.1130.862.77
TAQ-ISBackbone=Qwen2.5-3B2025.1130.762.25
AWQBackbone=Qwen2-7B2025.1129.155.19
TAQ-KLBackbone=Qwen2.5-3B2025.1128.032.25
GPTQBackbone=Qwen2-7B2025.1123.835.19
AWQBackbone=Qwen2.5-7B2025.1123.545.19
GPTQBackbone=Qwen2.5-7B2025.1118.515.19
GPTQBackbone=Qwen2.5-3B2025.1113.571.93
AWQBackbone=Qwen2.5-3B2025.119.862.5