Question Answering on MultiRC
87.82F1 ScoreOLTQA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OLTQAConfiguration=Full2023.05 | 87.82 | — | |
| OLTQARe-ranker=excluded2023.05 | 87.18 | — | |
| Hyperformer++2023.05 | 86.86 | — | |
| OLTQAAblation=without Pk2023.05 | 85.9 | — | |
| OLTQAAblation=without Pm2023.05 | 85.58 | — | |
| Muppet2023.05 | 85.57 | — | |
| OLTQAKnowledge Distillation=without MKD2023.05 | 84.94 | — | |
| OLTQARetriever=EPR2023.05 | 83.65 | — | |
| OLTQAKnowledge Distillation=Back KD2023.05 | 83.18 | — | |
| OLTQAKnowledge Distillation=Static MKD2023.05 | 82.54 | — | |
| UnifiedQA2023.05 | 80.45 | — | |
| OLTQARetriever=BM252023.05 | 78.85 | — | |
| ProQA2023.05 | 77.56 | — | |
| EPR2023.05 | 56.41 | — | |
| UnifiedQAseen_dataset_during_training=false, training_format=multi-format2020.05 | — | 59.9 | |
| UnifiedQA [AB]seen_dataset_during_training=false, training_format=abstractive2020.05 | — | 28.4 | |
| UnifiedQA [EX]seen_dataset_during_training=false, training_format=extractive2020.05 | — | 7.2 | |
| UnifiedQA [MC]seen_dataset_during_training=false, training_format=multiple choice2020.05 | — | 9.7 | |
| UnifiedQA [YN]seen_dataset_during_training=false, training_format=yes/no2020.05 | — | 91.7 |