Reading Comprehension on ROPES (F1)
58.64F1 ScoreOLTQA
Evaluation Results
| Method | Links | |
|---|---|---|
| OLTQAConfiguration=Full2023.05 | 58.64 | |
| OLTQAAblation=without Pk2023.05 | 57.96 | |
| UnifiedQA2023.05 | 57.9 | |
| Hyperformer++2023.05 | 57.04 | |
| OLTQAKnowledge Distillation=Back KD2023.05 | 55.51 | |
| Muppet2023.05 | 55.42 | |
| OLTQAKnowledge Distillation=Static MKD2023.05 | 54.67 | |
| OLTQARetriever=EPR2023.05 | 54.21 | |
| OLTQARetriever=BM252023.05 | 54.1 | |
| OLTQAAblation=without Pm2023.05 | 54 | |
| OLTQARe-ranker=excluded2023.05 | 53.28 | |
| OLTQAKnowledge Distillation=without MKD2023.05 | 52.66 | |
| EPR2023.05 | 47.96 | |
| ProQA2023.05 | 30.1 |