Multiple Choice Question Answering on MCTest
100AccuracyQA+E+C
Evaluation Results
| Method | Links | |
|---|---|---|
| QA+E+CCoverage=20%2022.09 | 100 | |
| QA+CCoverage=50%2022.09 | 99.76 | |
| QA+E+Cmodel=RoBERTa-RACE, entailment=true, contradiction=true2022.09 | 91.43 | |
| QA+Emodel=RoBERTa-RACE, entailment=true2022.09 | 91.07 | |
| QA+Cmodel=RoBERTa-RACE, contradiction=true2022.09 | 90.83 | |
| QAmodel=RoBERTa-RACE2022.09 | 90.48 | |
| OLTQAKnowledge Distillation=Back KD2023.05 | 85.63 | |
| OLTQAConfiguration=Full2023.05 | 83.75 | |
| OLTQAAblation=without Pm2023.05 | 83.02 | |
| OLTQAKnowledge Distillation=without MKD2023.05 | 82.19 | |
| OLTQARetriever=EPR2023.05 | 81.98 | |
| OLTQAKnowledge Distillation=Static MKD2023.05 | 81.87 | |
| OLTQARetriever=BM252023.05 | 81.56 | |
| OLTQARe-ranker=excluded2023.05 | 80.94 | |
| ProQA2023.05 | 80 | |
| Muppet2023.05 | 79.06 | |
| UnifiedQA2023.05 | 77.19 | |
| Hyperformer++2023.05 | 76.88 | |
| OLTQAAblation=without Pk2023.05 | 76.25 | |
| SciQ-smallvariant=small2022.09 | 59.76 | |
| EPR2023.05 | 55 | |
| SciQ-basevariant=base2022.09 | 44.76 |