Question Answering on OQA (Accuracy)
49.8AccuracyGenKnowSub
Evaluation Results
| Method | Links | |
|---|---|---|
| GenKnowSubBase Model=Phi-2, Setting=En, Evaluation Protocol=zero-shot2025.05 | 49.8 | |
| ArrowBase Model=Phi-2, Evaluation Protocol=zero-shot2025.05 | 48.6 | |
| GenKnowSubBase Model=Phi-2, Setting=Avg, Evaluation Protocol=zero-shot2025.05 | 47.8 | |
| Phi-2Base Model=Phi-2, Evaluation Protocol=zero-shot2025.05 | 44 | |
| LLM-Pruner+FinetuneParam Ratio=0.90, Base Model=LLaMA-3-8b, Fine-tuning Protocol=Alpaca dataset2025.12 | 35 | |
| BaselineParam Ratio=1.00, Base Model=LLaMA-3-8b, Fine-tuning Protocol=None2025.12 | 34.8 | |
| LLRCParam Ratio=0.90, Base Model=LLaMA-2-7b, Fine-tuning Protocol=None2025.12 | 33.4 | |
| LLM-Pruner+FinetuneParam Ratio=0.90, Base Model=LLaMA-2-7b, Fine-tuning Protocol=Alpaca dataset2025.12 | 33 | |
| LLM-Pruner+FinetuneParam Ratio=0.85, Base Model=LLaMA-2-7b, Fine-tuning Protocol=Alpaca dataset2025.12 | 33 | |
| LLRCParam Ratio=0.80, Base Model=LLaMA-2-7b, Fine-tuning Protocol=None2025.12 | 32.8 | |
| LLRCParam Ratio=0.85, Base Model=LLaMA-2-7b, Fine-tuning Protocol=None2025.12 | 32.4 | |
| LLRCParam Ratio=0.90, Base Model=LLaMA-3-8b, Fine-tuning Protocol=None2025.12 | 32.4 | |
| BaselineParam Ratio=1.00, Base Model=LLaMA-2-7b, Fine-tuning Protocol=None2025.12 | 31.4 | |
| LLM-PrunerParam Ratio=0.90, Base Model=LLaMA-2-7b, Fine-tuning Protocol=None2025.12 | 31 | |
| LLM-PrunerParam Ratio=0.85, Base Model=LLaMA-2-7b, Fine-tuning Protocol=None2025.12 | 31 | |
| LLM-PrunerParam Ratio=0.90, Base Model=LLaMA-3-8b, Fine-tuning Protocol=None2025.12 | 31 | |
| LLM-Pruner+FinetuneParam Ratio=0.85, Base Model=LLaMA-3-8b, Fine-tuning Protocol=Alpaca dataset2025.12 | 30.8 | |
| LLM-Pruner+FinetuneParam Ratio=0.80, Base Model=LLaMA-2-7b, Fine-tuning Protocol=Alpaca dataset2025.12 | 30.4 | |
| LLM-Pruner+FinetuneParam Ratio=0.80, Base Model=LLaMA-3-8b, Fine-tuning Protocol=Alpaca dataset2025.12 | 29.8 | |
| LLRCParam Ratio=0.85, Base Model=LLaMA-3-8b, Fine-tuning Protocol=None2025.12 | 29.6 | |
| LLM-PrunerParam Ratio=0.80, Base Model=LLaMA-2-7b, Fine-tuning Protocol=None2025.12 | 29 | |
| LLM-PrunerParam Ratio=0.85, Base Model=LLaMA-3-8b, Fine-tuning Protocol=None2025.12 | 28.8 | |
| LLRCParam Ratio=0.80, Base Model=LLaMA-3-8b, Fine-tuning Protocol=None2025.12 | 25.4 | |
| LLM-PrunerParam Ratio=0.80, Base Model=LLaMA-3-8b, Fine-tuning Protocol=None2025.12 | 24.4 |