Mathematical Reasoning on GSM8K ID (test)
54.59AccuracyWanda-Struct
Evaluation Results
| Method | Links | |
|---|---|---|
| Wanda-StructSparsity=30%, Backbone=Qwen-2.5-7B, Fine-tuning steps=150, PEFT Method=LoRA2026.05 | 54.59 | |
| AGFSparsity=30%, Backbone=Qwen-2.5-7B, Fine-tuning steps=150, PEFT Method=LoRA2026.05 | 46.1 | |
| RKUSparsity=30%, Backbone=Qwen-2.5-7B, Fine-tuning steps=150, PEFT Method=LoRA2026.05 | 45.53 | |
| Taylor-FOSparsity=30%, Backbone=Qwen-2.5-7B, Fine-tuning steps=150, PEFT Method=LoRA2026.05 | 40.45 | |
| Wanda-StructSparsity=40%, Backbone=Qwen-2.5-7B, Fine-tuning steps=150, PEFT Method=LoRA2026.05 | 39.95 | |
| AGFSparsity=40%, Backbone=Qwen-2.5-7B, Fine-tuning steps=150, PEFT Method=LoRA2026.05 | 33.06 | |
| RKUSparsity=40%, Backbone=Qwen-2.5-7B, Fine-tuning steps=150, PEFT Method=LoRA2026.05 | 30.48 | |
| Wanda-StructSparsity=50%, Backbone=Qwen-2.5-7B, Fine-tuning steps=150, PEFT Method=LoRA2026.05 | 29.49 | |
| Taylor-FOSparsity=40%, Backbone=Qwen-2.5-7B, Fine-tuning steps=150, PEFT Method=LoRA2026.05 | 23.01 | |
| AGFSparsity=50%, Backbone=Qwen-2.5-7B, Fine-tuning steps=150, PEFT Method=LoRA2026.05 | 18.57 | |
| RKUSparsity=50%, Backbone=Qwen-2.5-7B, Fine-tuning steps=150, PEFT Method=LoRA2026.05 | 15.69 | |
| Taylor-FOSparsity=50%, Backbone=Qwen-2.5-7B, Fine-tuning steps=150, PEFT Method=LoRA2026.05 | 10.27 |