Average Performance on Aggregate Seen Tasks
61.32Head@5OLTQA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| OLTQAConfiguration=Full2023.05 | 61.32 | 61.53 | 61.48 | |
| OLTQAKnowledge Distillation=Static MKD2023.05 | 60.9 | 59.83 | 60.09 | |
| OLTQAKnowledge Distillation=without MKD2023.05 | 60.57 | 59.59 | 59.82 | |
| OLTQARetriever=EPR2023.05 | 60.22 | 58.93 | 59.24 | |
| OLTQAKnowledge Distillation=Back KD2023.05 | 60.13 | 60.24 | 60.21 | |
| OLTQAAblation=without Pm2023.05 | 59.89 | 59.51 | 59.6 | |
| OLTQARe-ranker=excluded2023.05 | 59.67 | 58.02 | 58.41 | |
| OLTQARetriever=BM252023.05 | 59.62 | 57.57 | 58.06 | |
| Hyperformer++2023.05 | 59.46 | 55.99 | 56.81 | |
| OLTQAAblation=without Pk2023.05 | 59.45 | 55.59 | 56.51 | |
| Muppet2023.05 | 59.13 | 55.19 | 56.13 | |
| ProQA2023.05 | 58.88 | 51.47 | 53.23 | |
| UnifiedQA2023.05 | 58.57 | 54.16 | 55.21 | |
| EPR2023.05 | 47.76 | 48.04 | 47.97 |