Question Answering on AdversarialQA dBERT
39.51AccuracyOLTQA
Evaluation Results
| Method | Links | |
|---|---|---|
| OLTQAFull Config=True2023.05 | 39.51 | |
| OLTQARetriever Type=EPR2023.05 | 37.26 | |
| EPR2023.05 | 37 | |
| OLTQARe-ranking=False2023.05 | 36.93 | |
| OLTQARetriever Type=BM252023.05 | 35.1 | |
| OLTQAPrefix Prompting (Pm/Pk)=Pk only2023.05 | 34.51 | |
| OLTQAKnowledge Distillation=None2023.05 | 32.94 | |
| OLTQAKnowledge Distillation=Static MKD2023.05 | 32.47 | |
| OLTQAKnowledge Distillation=Back KD2023.05 | 31.66 | |
| UnifiedQA2023.05 | 24.39 | |
| OLTQAPrefix Prompting (Pm/Pk)=Pm only2023.05 | 24.29 | |
| ProQA2023.05 | 24.13 | |
| Muppet2023.05 | 22.1 | |
| Hyperformer++2023.05 | 20.09 |