Grounded Question Answering on SQuAD Title ID v1 (test)
73.7EMOpen-Book QA
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Open-Book QApassage_memorization=false, setup=upper bound2024.03 | 73.7 | 79.3 | |
| Recitationpassage_memorization=true, ID_Type=Golden ID, Recitation=true2024.03 | 59.7 | 68 | |
| Grounded QApassage_memorization=true, ID_Type=Golden ID, Recitation=false2024.03 | 26.7 | 35.6 | |
| Recitationpassage_memorization=true, ID_Type=None, Recitation=true2024.03 | 26.3 | 33.1 | |
| Grounded QApassage_memorization=true, ID_Type=None, Recitation=false2024.03 | 22 | 31 | |
| Grounded QApassage_memorization=true, ID_Type=Random ID, Recitation=false2024.03 | 20.7 | 28.9 | |
| Recitationpassage_memorization=true, ID_Type=Random ID, Recitation=true2024.03 | 16 | 20.4 | |
| Closed-Book QApassage_memorization=false, setup=lower bound2024.03 | 9 | 16.6 |