Grounded Question Answering on SQuAD Rare ID v1 (test)
73.7EMOpen-Book QA
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Open-Book QApassage_memorization=false, setup=upper bound2024.03 | 73.7 | 79.3 | |
| Recitationpassage_memorization=true, ID_Type=Golden ID, Recitation=true2024.03 | 54.7 | 62.1 | |
| Recitationpassage_memorization=true, ID_Type=None, Recitation=true2024.03 | 26.3 | 33.1 | |
| Grounded QApassage_memorization=true, ID_Type=None, Recitation=false2024.03 | 22 | 31 | |
| Grounded QApassage_memorization=true, ID_Type=Golden ID, Recitation=false2024.03 | 20.7 | 28.7 | |
| Grounded QApassage_memorization=true, ID_Type=Random ID, Recitation=false2024.03 | 20.7 | 28.3 | |
| Recitationpassage_memorization=true, ID_Type=Random ID, Recitation=true2024.03 | 18.7 | 23.6 | |
| Closed-Book QApassage_memorization=false, setup=lower bound2024.03 | 9 | 16.6 |