Grounded Question Answering on SQuAD Num ID v1 (test)
73.7EMOpen-Book QA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Open-Book QApassage_memorization=false, setup=upper bound2024.03 | 73.7 | 79.3 | |
| Recitationpassage_memorization=true, ID_Type=Golden ID, Recitation=true2024.03 | 57.7 | 66.2 | |
| Recitationpassage_memorization=true, ID_Type=None, Recitation=true2024.03 | 26.3 | 33.1 | |
| Grounded QApassage_memorization=true, ID_Type=Golden ID, Recitation=false2024.03 | 24.3 | 32.6 | |
| Grounded QApassage_memorization=true, ID_Type=Random ID, Recitation=false2024.03 | 23.3 | 31.6 | |
| Grounded QApassage_memorization=true, ID_Type=None, Recitation=false2024.03 | 22 | 31 | |
| Recitationpassage_memorization=true, ID_Type=Random ID, Recitation=true2024.03 | 18.7 | 23.1 | |
| Closed-Book QApassage_memorization=false, setup=lower bound2024.03 | 9 | 16.6 |