General Knowledge QA on OBQA
48Normalized AccuracyQwen2.5-7B-Instruct
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen2.5-7B-InstructBackbone=Qwen2.5-7B-Instruct, Ratio=0%, Recovery finetuning=false2026.06 | 48 | |
| Qwen2.5-7B-InstructBackbone=Qwen2.5-7B-Instruct, Ratio=0%, Recovery finetuning=true2026.06 | 48 | |
| Depth PruningBackbone=Qwen2.5-7B-Instruct, Ratio=25%, Recovery finetuning=true2026.06 | 46 | |
| LLM-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=25%, Recovery finetuning=false2026.06 | 45 | |
| Depth PruningBackbone=Qwen2.5-7B-Instruct, Ratio=25%, Recovery finetuning=false2026.06 | 44 | |
| LLM-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=25%, Recovery finetuning=true2026.06 | 44 | |
| Qwen2.5-3B-InstructBackbone=Qwen2.5-3B-Instruct, Ratio=0%, Recovery finetuning=false2026.06 | 42 | |
| Qwen2.5-3B-InstructBackbone=Qwen2.5-3B-Instruct, Ratio=0%, Recovery finetuning=true2026.06 | 42 | |
| LLM-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=25%, Recovery finetuning=true2026.06 | 42 | |
| Adapt-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=25%, Recovery finetuning=true2026.06 | 42 | |
| Adapt-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=25%, Recovery finetuning=true2026.06 | 41 | |
| Depth PruningBackbone=Qwen2.5-3B-Instruct, Ratio=25%, Recovery finetuning=false2026.06 | 40 | |
| LLM-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=25%, Recovery finetuning=false2026.06 | 40 | |
| Depth PruningBackbone=Qwen2.5-3B-Instruct, Ratio=25%, Recovery finetuning=true2026.06 | 40 | |
| Adapt-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=25%, Recovery finetuning=false2026.06 | 40 | |
| Persona-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=25%, Recovery finetuning=false2026.06 | 40 | |
| SliceGPTBackbone=Qwen2.5-7B-Instruct, Ratio=25%, Recovery finetuning=true2026.06 | 40 | |
| LLM-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=50%, Recovery finetuning=true2026.06 | 40 | |
| Adapt-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=25%, Recovery finetuning=false2026.06 | 39 | |
| Persona-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=25%, Recovery finetuning=true2026.06 | 39 | |
| Persona-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=25%, Recovery finetuning=true2026.06 | 38 | |
| SliceGPTBackbone=Qwen2.5-7B-Instruct, Ratio=25%, Recovery finetuning=false2026.06 | 38 | |
| Persona-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=25%, Recovery finetuning=false2026.06 | 37 | |
| Depth PruningBackbone=Qwen2.5-7B-Instruct, Ratio=50%, Recovery finetuning=true2026.06 | 37 | |
| Adapt-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=50%, Recovery finetuning=true2026.06 | 37 | |
| Persona-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=50%, Recovery finetuning=true2026.06 | 37 | |
| LLM-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=50%, Recovery finetuning=true2026.06 | 36 | |
| Adapt-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=50%, Recovery finetuning=true2026.06 | 36 | |
| LLM-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=50%, Recovery finetuning=false2026.06 | 36 | |
| Persona-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=50%, Recovery finetuning=false2026.06 | 36 | |
| SliceGPTBackbone=Qwen2.5-3B-Instruct, Ratio=25%, Recovery finetuning=true2026.06 | 35 | |
| Persona-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=50%, Recovery finetuning=false2026.06 | 35 | |
| Depth PruningBackbone=Qwen2.5-3B-Instruct, Ratio=50%, Recovery finetuning=true2026.06 | 35 | |
| Persona-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=50%, Recovery finetuning=true2026.06 | 35 | |
| Depth PruningBackbone=Qwen2.5-7B-Instruct, Ratio=50%, Recovery finetuning=false2026.06 | 35 | |
| LLM-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=50%, Recovery finetuning=false2026.06 | 34 | |
| Adapt-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=50%, Recovery finetuning=false2026.06 | 34 | |
| Adapt-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=50%, Recovery finetuning=false2026.06 | 34 | |
| Depth PruningBackbone=Qwen2.5-3B-Instruct, Ratio=50%, Recovery finetuning=false2026.06 | 31 | |
| SliceGPTBackbone=Qwen2.5-7B-Instruct, Ratio=50%, Recovery finetuning=true2026.06 | 31 | |
| SliceGPTBackbone=Qwen2.5-3B-Instruct, Ratio=25%, Recovery finetuning=false2026.06 | 30 | |
| SliceGPTBackbone=Qwen2.5-7B-Instruct, Ratio=50%, Recovery finetuning=false2026.06 | 30 | |
| SliceGPTBackbone=Qwen2.5-3B-Instruct, Ratio=50%, Recovery finetuning=false2026.06 | 27 | |
| SliceGPTBackbone=Qwen2.5-3B-Instruct, Ratio=50%, Recovery finetuning=true2026.06 | 27 |