Multiple Choice Question Answering on ARC hard
40.43AccuracyOLTQA
Evaluation results
| Method | Links | |
|---|---|---|
| OLTQAConfiguration=Full2023.05 | 40.43 | |
| OLTQAKnowledge Distillation=Back KD2023.05 | 40.22 | |
| EPR2023.05 | 39.8 | |
| OLTQAAblation=without Pm2023.05 | 39.46 | |
| OLTQAKnowledge Distillation=without MKD2023.05 | 39.46 | |
| OLTQAKnowledge Distillation=Static MKD2023.05 | 39.46 | |
| ProQA2023.05 | 38.13 | |
| OLTQARe-ranker=excluded2023.05 | 37.15 | |
| OLTQARetriever=EPR2023.05 | 36.12 | |
| OLTQARetriever=BM252023.05 | 34.78 | |
| OLTQAAblation=without Pk2023.05 | 33.11 | |
| UnifiedQA2023.05 | 31.77 | |
| Muppet2023.05 | 31.34 | |
| Hyperformer++2023.05 | 31.1 |