Question Answering on OpenBookQA (val)
36.6AccuracyLLM-Pruner+Finetune
Evaluation Results
| Method | Links | |
|---|---|---|
| LLM-Pruner+FinetuneBackbone=Llama-2-13b, Param Ratio=0.90, Fine-tuning=Alpaca2025.12 | 36.6 | |
| LLRCBackbone=Llama-2-13b, Param Ratio=0.80, Fine-tuning=None2025.12 | 36 | |
| LLRCBackbone=Llama-2-13b, Param Ratio=0.90, Fine-tuning=None2025.12 | 35.4 | |
| LLM-Pruner+FinetuneBackbone=Llama-2-13b, Param Ratio=0.80, Fine-tuning=Alpaca2025.12 | 35.4 | |
| BaselineBackbone=Llama-2-13b, Param Ratio=1.00, Fine-tuning=None2025.12 | 35.2 | |
| LLM-PrunerBackbone=Llama-2-13b, Param Ratio=0.90, Fine-tuning=None2025.12 | 35.2 | |
| SVD-LLM+FinetuneBackbone=Llama-2-13b, Param Ratio=0.90, Fine-tuning=Alpaca2025.12 | 33.8 | |
| LLRCBackbone=Llama-2-7b, Param Ratio=0.90, Fine-tuning=None2025.12 | 33.4 | |
| LLM-Pruner+FinetuneBackbone=Llama-2-7b, Param Ratio=0.90, Fine-tuning=Alpaca2025.12 | 33 | |
| LLRCBackbone=Llama-2-7b, Param Ratio=0.80, Fine-tuning=None2025.12 | 32.8 | |
| SVD-LLM+FinetuneBackbone=Llama-2-13b, Param Ratio=0.80, Fine-tuning=Alpaca2025.12 | 32.4 | |
| LLM-PrunerBackbone=Llama-2-13b, Param Ratio=0.80, Fine-tuning=None2025.12 | 32.2 | |
| BaselineBackbone=Llama-2-7b, Param Ratio=1.00, Fine-tuning=None2025.12 | 31.4 | |
| LLM-PrunerBackbone=Llama-2-7b, Param Ratio=0.90, Fine-tuning=None2025.12 | 31 | |
| SVD-LLM (w)Backbone=Llama-2-13b, Param Ratio=0.90, Fine-tuning=None2025.12 | 30.6 | |
| SVD-LLM+FinetuneBackbone=Llama-2-7b, Param Ratio=0.90, Fine-tuning=Alpaca2025.12 | 30.6 | |
| LLM-Pruner+FinetuneBackbone=Llama-2-7b, Param Ratio=0.80, Fine-tuning=Alpaca2025.12 | 30.4 | |
| SVD-LLM+FinetuneBackbone=Llama-2-7b, Param Ratio=0.80, Fine-tuning=Alpaca2025.12 | 29.6 | |
| LLM-PrunerBackbone=Llama-2-7b, Param Ratio=0.80, Fine-tuning=None2025.12 | 29 | |
| SVD-LLM (w)Backbone=Llama-2-13b, Param Ratio=0.80, Fine-tuning=None2025.12 | 28.8 | |
| SVD-LLM (w)Backbone=Llama-2-7b, Param Ratio=0.90, Fine-tuning=None2025.12 | 28.2 | |
| SVD-LLM (w)Backbone=Llama-2-7b, Param Ratio=0.80, Fine-tuning=None2025.12 | 25.6 |