Math Reasoning on MMLU-Pro
42.48EM ScoreW/O (FP16)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| W/O (FP16)Backbone=Gemma-2-9B2025.11 | 42.48 | 17.21 | |
| TAQ-KLBackbone=Gemma-2-9B2025.11 | 42.48 | 6.76 | |
| AWQBackbone=Gemma-2-9B2025.11 | 41.6 | 5.74 | |
| TAQ-ISBackbone=Gemma-2-9B2025.11 | 41.6 | 6.76 | |
| W/O (FP16)Backbone=Qwen2-7B2025.11 | 41.06 | 14.19 | |
| GPTQBackbone=Gemma-2-9B2025.11 | 40.63 | 5.75 | |
| SliM-LLMBackbone=Gemma-2-9B2025.11 | 39.89 | 5.83 | |
| TAQ-OBackbone=Gemma-2-9B2025.11 | 39.4 | 9.02 | |
| TAQ-KLBackbone=Qwen2-7B2025.11 | 39.11 | 5.95 | |
| TAQ-OBackbone=Qwen2-7B2025.11 | 38.57 | 9.05 | |
| SliM-LLMBackbone=Qwen2-7B2025.11 | 38.48 | 5.83 | |
| TAQ-ISBackbone=Qwen2-7B2025.11 | 37.99 | 5.95 | |
| W/O (FP16)Backbone=Qwen2.5-3B2025.11 | 37.5 | 5.75 | |
| TAQ-KLBackbone=Qwen2.5-7B2025.11 | 35.35 | 5.95 | |
| TAQ-ISBackbone=Qwen2.5-7B2025.11 | 33.35 | 5.95 | |
| W/O (FP16)Backbone=Qwen2.5-7B2025.11 | 33.2 | 14.19 | |
| TAQ-OBackbone=Qwen2.5-3B2025.11 | 33.01 | 3.2 | |
| TAQ-OBackbone=Qwen2.5-7B2025.11 | 32.13 | 9.05 | |
| SliM-LLMBackbone=Qwen2.5-7B2025.11 | 31.01 | 5.83 | |
| SliM-LLMBackbone=Qwen2.5-3B2025.11 | 30.86 | 2.77 | |
| TAQ-ISBackbone=Qwen2.5-3B2025.11 | 30.76 | 2.25 | |
| AWQBackbone=Qwen2-7B2025.11 | 29.15 | 5.19 | |
| TAQ-KLBackbone=Qwen2.5-3B2025.11 | 28.03 | 2.25 | |
| GPTQBackbone=Qwen2-7B2025.11 | 23.83 | 5.19 | |
| AWQBackbone=Qwen2.5-7B2025.11 | 23.54 | 5.19 | |
| GPTQBackbone=Qwen2.5-7B2025.11 | 18.51 | 5.19 | |
| GPTQBackbone=Qwen2.5-3B2025.11 | 13.57 | 1.93 | |
| AWQBackbone=Qwen2.5-3B2025.11 | 9.86 | 2.5 |