Open-domain question answering on NQ (val)
30.6EMLlama2-7b CBQA w. Mixed Training + Recitation
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Llama2-7b CBQA w. Mixed Training + RecitationModel=Llama2-7b, Setup=CBQA w. Mixed Training + Recitation2024.03 | 30.6 | 39.8 | 17.4 | |
| Llama2-7b + RecitationModel=Llama2-7b, Setup=Closed-book QA + Recitation2024.03 | 30.3 | 40.1 | 15.7 | |
| Llama2-7b CBQA w. Mixed TrainingModel=Llama2-7b, Setup=CBQA w. Mixed Training2024.03 | 27.6 | 40.2 | — | |
| Llama2-7b Closed-book QAModel=Llama2-7b, Setup=Closed-book QA2024.03 | 26.4 | 39 | — | |
| Qwen1.5-4b CBQA w. Mixed TrainingModel=Qwen1.5-4b, Setup=CBQA w. Mixed Training2024.03 | 21.2 | 29.4 | — | |
| Qwen1.5-4b Closed-book QAModel=Qwen1.5-4b, Setup=Closed-book QA2024.03 | 19.7 | 27.8 | — | |
| Qwen1.5-4b CBQA w. Mixed Training + RecitationModel=Qwen1.5-4b, Setup=CBQA w. Mixed Training + Recitation2024.03 | 17.4 | 24.1 | 13.6 | |
| Qwen1.5-4b + RecitationModel=Qwen1.5-4b, Setup=Closed-book QA + Recitation2024.03 | 16.3 | 24.1 | 11.4 |