Open-domain Question Answering on Natural Questions (NQ) open
14.99NQ Open ScoreLLaMA-2-7B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LLaMA-2-7B2024.06 | 14.99 | — | |
| LLaMA-2-7Bstatus=original pre-trained model2024.06 | 14.99 | — | |
| CorDA#Params=320M2024.06 | 14.43 | 19.5 | |
| LoRA#Params=320M2024.06 | 10.28 | 17.52 | |
| PiSSA#Params=320M2024.06 | 9.67 | 14.3 | |
| CorDABackbone=LLaMA-2-7B, #Params=320M, rank=128, Fine-tuning task=Math2024.06 | 9.36 | — | |
| Full fine-tuning#Params=6738M2024.06 | 8.45 | 11.69 | |
| Full fine-tuningBackbone=LLaMA-2-7B, #Params=6738M, Fine-tuning task=Math2024.06 | 3.13 | — | |
| LoRABackbone=LLaMA-2-7B, #Params=320M, rank=128, Fine-tuning task=Math2024.06 | 1.91 | — | |
| PiSSABackbone=LLaMA-2-7B, #Params=320M, rank=128, Fine-tuning task=Math2024.06 | 1.02 | — |