Open-Domain Question Answering on Trivia QA
52.51Trivia QA ScoreLLaMA-2-7B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LLaMA-2-7BBase Model=LLaMA-2-7B, Fine-tuning Dataset=WizardLM-Evol-Instruct, Evaluation Seeds=32026.05 | 52.51 | 25.1 | 100 | — | |
| FoLoRA#Param=320M, Base Model=LLaMA-2-7B, Fine-tuning Dataset=WizardLM-Evol-Instruct, Evaluation Seeds=32026.05 | 49.14 | 23.71 | 94.44 | 29.26 | |
| LoRA-Null#Param=320M, Base Model=LLaMA-2-7B, Fine-tuning Dataset=WizardLM-Evol-Instruct, Evaluation Seeds=32026.05 | 47.63 | 23.06 | 91.87 | 27.42 | |
| OPLoRA#Param=320M, Base Model=LLaMA-2-7B, Fine-tuning Dataset=WizardLM-Evol-Instruct, Evaluation Seeds=32026.05 | 46.9 | 21.39 | 85.21 | 24.75 | |
| MiLoRA#Param=320M, Base Model=LLaMA-2-7B, Fine-tuning Dataset=WizardLM-Evol-Instruct, Evaluation Seeds=32026.05 | 45.98 | 21.55 | 85.86 | 26.34 | |
| CorDA#Param=320M, Base Model=LLaMA-2-7B, Fine-tuning Dataset=WizardLM-Evol-Instruct, Evaluation Seeds=32026.05 | 45.34 | 22.37 | 89.13 | 27.76 | |
| LoRA#Param=320M, Base Model=LLaMA-2-7B, Fine-tuning Dataset=WizardLM-Evol-Instruct, Evaluation Seeds=32026.05 | 42.76 | 18.94 | 75.45 | 24.8 |