Question Answering on Seen QA Tasks
79.99SQuAD 2OLTQA
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| OLTQAmeta prompts (Pm)=true, knowledge prompts (Pk)=true2023.05 | 79.99 | 42.68 | 59.65 | 58.95 | 83.75 | 40.43 | 87.82 | 60.77 | 67.74 | 61.48 | |
| ProQA2023.05 | 79.84 | 39.01 | 59.55 | 44.21 | 80 | 38.13 | 77.56 | 59.47 | 59.98 | 53.23 | |
| Hyperformer++2023.05 | 79.52 | 40.24 | 58.24 | 40.18 | 76.88 | 31.1 | 86.86 | 59.33 | 58.76 | 56.81 | |
| Muppet2023.05 | 79.41 | 40.83 | 57.13 | 38.07 | 79.06 | 31.34 | 85.57 | 59.12 | 58.51 | 56.13 | |
| OLTQA (w/o Pk)meta prompts (Pm)=true, knowledge prompts (Pk)=false2023.05 | 78.89 | 40.2 | 59.34 | 39.82 | 76.25 | 33.11 | 85.9 | 59.48 | 58.77 | 56.51 | |
| UnifiedQA2023.05 | 77.8 | 40.25 | 56.97 | 36.84 | 77.19 | 31.77 | 80.45 | 58.34 | 56.56 | 55.21 | |
| OLTQA (w/o Pm)meta prompts (Pm)=false, knowledge prompts (Pk)=true2023.05 | 77.72 | 42.1 | 58.13 | 56.49 | 83.02 | 39.46 | 85.58 | 59.32 | 66.14 | 59.6 | |
| EPR2023.05 | 44.14 | 39.5 | 38.82 | 51.81 | 55 | 39.8 | 56.41 | 40.82 | 50.76 | 47.97 |