List your company
ResearchFormerly WizWand

Question Answering on OpenBookQA (val)

36.6AccuracyLLM-Pruner+Finetune
25.1628.1331.134.07Dec 14, 2025
Updated 8mo ago

Evaluation results

MethodLinks
LLM-Pruner+FinetuneBackbone=Llama-2-13b, Param Ratio=0.90, Fine-tuning=Alpaca2025.1236.6
LLRCBackbone=Llama-2-13b, Param Ratio=0.80, Fine-tuning=None2025.1236
LLRCBackbone=Llama-2-13b, Param Ratio=0.90, Fine-tuning=None2025.1235.4
LLM-Pruner+FinetuneBackbone=Llama-2-13b, Param Ratio=0.80, Fine-tuning=Alpaca2025.1235.4
BaselineBackbone=Llama-2-13b, Param Ratio=1.00, Fine-tuning=None2025.1235.2
LLM-PrunerBackbone=Llama-2-13b, Param Ratio=0.90, Fine-tuning=None2025.1235.2
SVD-LLM+FinetuneBackbone=Llama-2-13b, Param Ratio=0.90, Fine-tuning=Alpaca2025.1233.8
LLRCBackbone=Llama-2-7b, Param Ratio=0.90, Fine-tuning=None2025.1233.4
LLM-Pruner+FinetuneBackbone=Llama-2-7b, Param Ratio=0.90, Fine-tuning=Alpaca2025.1233
LLRCBackbone=Llama-2-7b, Param Ratio=0.80, Fine-tuning=None2025.1232.8
SVD-LLM+FinetuneBackbone=Llama-2-13b, Param Ratio=0.80, Fine-tuning=Alpaca2025.1232.4
LLM-PrunerBackbone=Llama-2-13b, Param Ratio=0.80, Fine-tuning=None2025.1232.2
BaselineBackbone=Llama-2-7b, Param Ratio=1.00, Fine-tuning=None2025.1231.4
LLM-PrunerBackbone=Llama-2-7b, Param Ratio=0.90, Fine-tuning=None2025.1231
SVD-LLM (w)Backbone=Llama-2-13b, Param Ratio=0.90, Fine-tuning=None2025.1230.6
SVD-LLM+FinetuneBackbone=Llama-2-7b, Param Ratio=0.90, Fine-tuning=Alpaca2025.1230.6
LLM-Pruner+FinetuneBackbone=Llama-2-7b, Param Ratio=0.80, Fine-tuning=Alpaca2025.1230.4
SVD-LLM+FinetuneBackbone=Llama-2-7b, Param Ratio=0.80, Fine-tuning=Alpaca2025.1229.6
LLM-PrunerBackbone=Llama-2-7b, Param Ratio=0.80, Fine-tuning=None2025.1229
SVD-LLM (w)Backbone=Llama-2-13b, Param Ratio=0.80, Fine-tuning=None2025.1228.8
SVD-LLM (w)Backbone=Llama-2-7b, Param Ratio=0.90, Fine-tuning=None2025.1228.2
SVD-LLM (w)Backbone=Llama-2-7b, Param Ratio=0.80, Fine-tuning=None2025.1225.6