Question Answering on Hotpot QA (val)
24.6EMLlama2-7b CBQA w. Mixed Training
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Llama2-7b CBQA w. Mixed TrainingModel=Llama2-7b, Setup=CBQA w. Mixed Training2024.03 | 24.6 | 34.6 | — | |
| Llama2-7b Closed-book QAModel=Llama2-7b, Setup=Closed-book QA2024.03 | 24.1 | 33.8 | — | |
| Llama2-7b + RecitationModel=Llama2-7b, Setup=Closed-book QA + Recitation2024.03 | 22.7 | 31.4 | 22.2 | |
| Llama2-7b CBQA w. Mixed Training + RecitationModel=Llama2-7b, Setup=CBQA w. Mixed Training + Recitation2024.03 | 22.4 | 30.7 | 23.8 | |
| Qwen1.5-4b CBQA w. Mixed TrainingModel=Qwen1.5-4b, Setup=CBQA w. Mixed Training2024.03 | 19.3 | 28.3 | — | |
| Qwen1.5-4b Closed-book QAModel=Qwen1.5-4b, Setup=Closed-book QA2024.03 | 18.6 | 27 | — | |
| Qwen1.5-4b CBQA w. Mixed Training + RecitationModel=Qwen1.5-4b, Setup=CBQA w. Mixed Training + Recitation2024.03 | 18.4 | 25.1 | 32.7 | |
| Qwen1.5-4b + RecitationModel=Qwen1.5-4b, Setup=Closed-book QA + Recitation2024.03 | 16.7 | 24.5 | 17.4 |