Multiple Choice Question Answering on QASC
100AccuracyQA
Evaluation Results
| Method | Links | |
|---|---|---|
| QACoverage=20%2022.09 | 100 | |
| QACoverage=50%2022.09 | 100 | |
| QA+E+Cmodel=RoBERTa-RACE, entailment=true, contradiction=true2022.09 | 98.6 | |
| QA+Emodel=RoBERTa-RACE, entailment=true2022.09 | 98.49 | |
| QA+Cmodel=RoBERTa-RACE, contradiction=true2022.09 | 98.38 | |
| QAmodel=RoBERTa-RACE2022.09 | 98.16 | |
| SciQ-basevariant=base2022.09 | 93.41 | |
| SciQ-smallvariant=small2022.09 | 90.6 | |
| OLTQAKnowledge Distillation=Back KD2023.05 | 51.08 | |
| OLTQAConfiguration=Full2023.05 | 50.65 | |
| OLTQAKnowledge Distillation=Static MKD2023.05 | 48.92 | |
| OLTQAKnowledge Distillation=without MKD2023.05 | 46 | |
| OLTQARetriever=EPR2023.05 | 43.63 | |
| OLTQAAblation=without Pm2023.05 | 43.09 | |
| OLTQARetriever=BM252023.05 | 42.76 | |
| OLTQARe-ranker=excluded2023.05 | 39.52 | |
| EPR2023.05 | 38.09 | |
| OLTQAAblation=without Pk2023.05 | 36.83 | |
| UnifiedQA2023.05 | 34.88 | |
| Hyperformer++2023.05 | 33.15 | |
| Muppet2023.05 | 32.62 | |
| ProQA2023.05 | 31.1 |