Open Domain Question Answering on NQ open (test)
23.63AccuracyPre-trained
Evaluation results
| Method | Links | |
|---|---|---|
| Pre-trainedModel=LLaMA-2-13B2024.06 | 23.63 | |
| CorDA (KPM)Model=LLaMA-2-13B, Adaptation Mode=Knowledge-Preserved Adaptation Mode2024.06 | 19.86 | |
| LoRAModel=LLaMA-2-13B2024.06 | 16.26 | |
| Pre-trainedModel=LLaMA-3-8B2024.06 | 13.41 | |
| Pre-trainedModel=Gemma-2-9B2024.06 | 12.85 | |
| CorDA (KPM)Model=Gemma-2-9B, Adaptation Mode=Knowledge-Preserved Adaptation Mode2024.06 | 10.17 | |
| CorDA (KPM)Model=LLaMA-3-8B, Adaptation Mode=Knowledge-Preserved Adaptation Mode2024.06 | 9.61 | |
| LoRAModel=Gemma-2-9B2024.06 | 9.28 | |
| LoRAModel=LLaMA-3-8B2024.06 | 8.75 |