General Knowledge QA on PIQA
80AccuracyQwen2.5-7B-Instruct
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Qwen2.5-7B-InstructBackbone=Qwen2.5-7B-Instruct, Ratio=0%, Recovery finetuning=false2026.06 | 80 | — | |
| Qwen2.5-7B-InstructBackbone=Qwen2.5-7B-Instruct, Ratio=0%, Recovery finetuning=true2026.06 | 80 | — | |
| Depth PruningBackbone=Qwen2.5-7B-Instruct, Ratio=25%, Recovery finetuning=true2026.06 | 80 | — | |
| LLM-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=25%, Recovery finetuning=true2026.06 | 79 | — | |
| Qwen2.5-3B-InstructBackbone=Qwen2.5-3B-Instruct, Ratio=0%, Recovery finetuning=false2026.06 | 78 | — | |
| Qwen2.5-3B-InstructBackbone=Qwen2.5-3B-Instruct, Ratio=0%, Recovery finetuning=true2026.06 | 78 | — | |
| Depth PruningBackbone=Qwen2.5-7B-Instruct, Ratio=25%, Recovery finetuning=false2026.06 | 78 | — | |
| LLM-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=25%, Recovery finetuning=false2026.06 | 77 | — | |
| Depth PruningBackbone=Qwen2.5-3B-Instruct, Ratio=25%, Recovery finetuning=true2026.06 | 76 | — | |
| LLM-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=25%, Recovery finetuning=true2026.06 | 76 | — | |
| Adapt-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=25%, Recovery finetuning=true2026.06 | 75 | — | |
| Depth PruningBackbone=Qwen2.5-3B-Instruct, Ratio=25%, Recovery finetuning=false2026.06 | 74 | — | |
| LLM-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=25%, Recovery finetuning=false2026.06 | 74 | — | |
| Adapt-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=25%, Recovery finetuning=true2026.06 | 74 | — | |
| Depth PruningBackbone=Qwen2.5-7B-Instruct, Ratio=50%, Recovery finetuning=true2026.06 | 74 | — | |
| LLM-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=50%, Recovery finetuning=true2026.06 | 74 | — | |
| Adapt-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=25%, Recovery finetuning=false2026.06 | 73 | — | |
| Persona-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=25%, Recovery finetuning=false2026.06 | 73 | — | |
| Adapt-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=25%, Recovery finetuning=false2026.06 | 71 | — | |
| SliceGPTBackbone=Qwen2.5-7B-Instruct, Ratio=25%, Recovery finetuning=true2026.06 | 71 | — | |
| Persona-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=25%, Recovery finetuning=false2026.06 | 70 | — | |
| LLM-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=50%, Recovery finetuning=true2026.06 | 70 | — | |
| Adapt-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=50%, Recovery finetuning=true2026.06 | 70 | — | |
| Persona-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=25%, Recovery finetuning=true2026.06 | 69 | — | |
| Depth PruningBackbone=Qwen2.5-3B-Instruct, Ratio=50%, Recovery finetuning=true2026.06 | 69 | — | |
| Persona-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=25%, Recovery finetuning=true2026.06 | 69 | — | |
| Depth PruningBackbone=Qwen2.5-7B-Instruct, Ratio=50%, Recovery finetuning=false2026.06 | 69 | — | |
| LLM-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=50%, Recovery finetuning=false2026.06 | 69 | — | |
| Adapt-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=50%, Recovery finetuning=true2026.06 | 68 | — | |
| SliceGPTBackbone=Qwen2.5-7B-Instruct, Ratio=25%, Recovery finetuning=false2026.06 | 68 | — | |
| Persona-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=50%, Recovery finetuning=false2026.06 | 68 | — | |
| SliceGPTBackbone=Qwen2.5-3B-Instruct, Ratio=25%, Recovery finetuning=true2026.06 | 66 | — | |
| LLM-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=50%, Recovery finetuning=false2026.06 | 66 | — | |
| Adapt-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=50%, Recovery finetuning=false2026.06 | 66 | — | |
| Persona-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=50%, Recovery finetuning=false2026.06 | 65 | — | |
| Persona-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=50%, Recovery finetuning=true2026.06 | 65 | — | |
| Persona-PrunerBackbone=Qwen2.5-7B-Instruct, Ratio=50%, Recovery finetuning=true2026.06 | 65 | — | |
| SliceGPTBackbone=Qwen2.5-3B-Instruct, Ratio=25%, Recovery finetuning=false2026.06 | 64 | — | |
| Depth PruningBackbone=Qwen2.5-3B-Instruct, Ratio=50%, Recovery finetuning=false2026.06 | 64 | — | |
| Adapt-PrunerBackbone=Qwen2.5-3B-Instruct, Ratio=50%, Recovery finetuning=false2026.06 | 64 | — | |
| SliceGPTBackbone=Qwen2.5-7B-Instruct, Ratio=50%, Recovery finetuning=true2026.06 | 64 | — | |
| SliceGPTBackbone=Qwen2.5-7B-Instruct, Ratio=50%, Recovery finetuning=false2026.06 | 61 | — | |
| SliceGPTBackbone=Qwen2.5-3B-Instruct, Ratio=50%, Recovery finetuning=true2026.06 | 57 | — | |
| SliceGPTBackbone=Qwen2.5-3B-Instruct, Ratio=50%, Recovery finetuning=false2026.06 | 54 | — | |
| Adapt-PrunerRatio=25%, Recovery finetuning=w/o, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 70 | |
| Adapt-PrunerRatio=25%, Recovery finetuning=w/, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 72 | |
| Adapt-PrunerRatio=50%, Recovery finetuning=w/o, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 60 | |
| Adapt-PrunerRatio=50%, Recovery finetuning=w/, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 65 | |
| Adapt-PrunerRatio=25%, Recovery finetuning=w/o, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 71 | |
| Adapt-PrunerRatio=25%, Recovery finetuning=w/, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 76 | |
| Adapt-PrunerRatio=50%, Recovery finetuning=w/o, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 58 | |
| Adapt-PrunerRatio=50%, Recovery finetuning=w/, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 70 | |
| Depth PruningRatio=25%, Recovery finetuning=w/o, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 70 | |
| Depth PruningRatio=25%, Recovery finetuning=w/, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 73 | |
| Depth PruningRatio=50%, Recovery finetuning=w/o, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 61 | |
| Depth PruningRatio=50%, Recovery finetuning=w/, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 66 | |
| Depth PruningRatio=25%, Recovery finetuning=w/o, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 77 | |
| Depth PruningRatio=25%, Recovery finetuning=w/, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 79 | |
| Depth PruningRatio=50%, Recovery finetuning=w/o, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 67 | |
| Depth PruningRatio=50%, Recovery finetuning=w/, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 73 | |
| Llama-3.1-8B-InstructRatio=0%, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 81 | |
| Llama-3.2-3B-InstructRatio=0%, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 76 | |
| LLM-PrunerRatio=25%, Recovery finetuning=w/o, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 72 | |
| LLM-PrunerRatio=25%, Recovery finetuning=w/, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 73 | |
| LLM-PrunerRatio=50%, Recovery finetuning=w/o, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 67 | |
| LLM-PrunerRatio=50%, Recovery finetuning=w/, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 69 | |
| LLM-PrunerRatio=25%, Recovery finetuning=w/o, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 78 | |
| LLM-PrunerRatio=25%, Recovery finetuning=w/, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 79 | |
| LLM-PrunerRatio=50%, Recovery finetuning=w/o, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 72 | |
| LLM-PrunerRatio=50%, Recovery finetuning=w/, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 74 | |
| Persona-PrunerRatio=25%, Recovery finetuning=w/o, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 71 | |
| Persona-PrunerRatio=25%, Recovery finetuning=w/, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 69 | |
| Persona-PrunerRatio=50%, Recovery finetuning=w/o, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 64 | |
| Persona-PrunerRatio=50%, Recovery finetuning=w/, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 65 | |
| Persona-PrunerRatio=25%, Recovery finetuning=w/o, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 75 | |
| Persona-PrunerRatio=25%, Recovery finetuning=w/, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 68 | |
| Persona-PrunerRatio=50%, Recovery finetuning=w/o, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 68 | |
| Persona-PrunerRatio=50%, Recovery finetuning=w/, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 65 | |
| SliceGPTRatio=25%, Recovery finetuning=w/o, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 58 | |
| SliceGPTRatio=25%, Recovery finetuning=w/, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 65 | |
| SliceGPTRatio=50%, Recovery finetuning=w/o, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 52 | |
| SliceGPTRatio=50%, Recovery finetuning=w/, Base Model=Llama-3.2-3B-Instruct2026.06 | — | 55 | |
| SliceGPTRatio=25%, Recovery finetuning=w/o, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 63 | |
| SliceGPTRatio=25%, Recovery finetuning=w/, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 70 | |
| SliceGPTRatio=50%, Recovery finetuning=w/o, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 53 | |
| SliceGPTRatio=50%, Recovery finetuning=w/, Base Model=Llama-3.1-8B-Instruct2026.06 | — | 58 |