List your company
ResearchFormerly WizWand

Question Answering on OQA (Accuracy)

49.8AccuracyGenKnowSub
23.38430.24237.143.958May 16, 2025Jun 20, 2025Jul 25, 2025Aug 30, 2025Oct 4, 2025Nov 8, 2025Dec 14, 2025
Updated 8mo ago

Evaluation results

MethodLinks
GenKnowSubBase Model=Phi-2, Setting=En, Evaluation Protocol=zero-shot2025.0549.8
ArrowBase Model=Phi-2, Evaluation Protocol=zero-shot2025.0548.6
GenKnowSubBase Model=Phi-2, Setting=Avg, Evaluation Protocol=zero-shot2025.0547.8
Phi-2Base Model=Phi-2, Evaluation Protocol=zero-shot2025.0544
LLM-Pruner+FinetuneParam Ratio=0.90, Base Model=LLaMA-3-8b, Fine-tuning Protocol=Alpaca dataset2025.1235
BaselineParam Ratio=1.00, Base Model=LLaMA-3-8b, Fine-tuning Protocol=None2025.1234.8
LLRCParam Ratio=0.90, Base Model=LLaMA-2-7b, Fine-tuning Protocol=None2025.1233.4
LLM-Pruner+FinetuneParam Ratio=0.90, Base Model=LLaMA-2-7b, Fine-tuning Protocol=Alpaca dataset2025.1233
LLM-Pruner+FinetuneParam Ratio=0.85, Base Model=LLaMA-2-7b, Fine-tuning Protocol=Alpaca dataset2025.1233
LLRCParam Ratio=0.80, Base Model=LLaMA-2-7b, Fine-tuning Protocol=None2025.1232.8
LLRCParam Ratio=0.85, Base Model=LLaMA-2-7b, Fine-tuning Protocol=None2025.1232.4
LLRCParam Ratio=0.90, Base Model=LLaMA-3-8b, Fine-tuning Protocol=None2025.1232.4
BaselineParam Ratio=1.00, Base Model=LLaMA-2-7b, Fine-tuning Protocol=None2025.1231.4
LLM-PrunerParam Ratio=0.90, Base Model=LLaMA-2-7b, Fine-tuning Protocol=None2025.1231
LLM-PrunerParam Ratio=0.85, Base Model=LLaMA-2-7b, Fine-tuning Protocol=None2025.1231
LLM-PrunerParam Ratio=0.90, Base Model=LLaMA-3-8b, Fine-tuning Protocol=None2025.1231
LLM-Pruner+FinetuneParam Ratio=0.85, Base Model=LLaMA-3-8b, Fine-tuning Protocol=Alpaca dataset2025.1230.8
LLM-Pruner+FinetuneParam Ratio=0.80, Base Model=LLaMA-2-7b, Fine-tuning Protocol=Alpaca dataset2025.1230.4
LLM-Pruner+FinetuneParam Ratio=0.80, Base Model=LLaMA-3-8b, Fine-tuning Protocol=Alpaca dataset2025.1229.8
LLRCParam Ratio=0.85, Base Model=LLaMA-3-8b, Fine-tuning Protocol=None2025.1229.6
LLM-PrunerParam Ratio=0.80, Base Model=LLaMA-2-7b, Fine-tuning Protocol=None2025.1229
LLM-PrunerParam Ratio=0.85, Base Model=LLaMA-3-8b, Fine-tuning Protocol=None2025.1228.8
LLRCParam Ratio=0.80, Base Model=LLaMA-3-8b, Fine-tuning Protocol=None2025.1225.4
LLM-PrunerParam Ratio=0.80, Base Model=LLaMA-3-8b, Fine-tuning Protocol=None2025.1224.4