Question Answering on RACE-C
93.66AccuracyQA
Evaluation Results
| Method | Links | |
|---|---|---|
| QACoverage=20%2022.09 | 93.66 | |
| QACoverage=50%2022.09 | 87.36 | |
| QAmodel=RoBERTa-RACE2022.09 | 69.8 | |
| QA+E+Cmodel=RoBERTa-RACE, entailment=true, contradiction=true2022.09 | 69.8 | |
| QA+Cmodel=RoBERTa-RACE, contradiction=true2022.09 | 69.8 | |
| QA+Emodel=RoBERTa-RACE, entailment=true2022.09 | 69.66 | |
| OLTQAsetting=zero-shot2023.05 | 56.88 | |
| OLTQAFull Config=True2023.05 | 56.88 | |
| ProQAsetting=zero-shot2023.05 | 54.91 | |
| ProQA2023.05 | 54.91 | |
| OLTQA (w/o Pm)setting=zero-shot2023.05 | 53.51 | |
| OLTQA (w/o Pk)setting=zero-shot2023.05 | 53.23 | |
| Hyperformer++setting=zero-shot2023.05 | 52.11 | |
| Muppetsetting=zero-shot2023.05 | 50 | |
| UnifiedQAsetting=zero-shot2023.05 | 49.86 | |
| UnifiedQA2023.05 | 49.86 | |
| EPRsetting=zero-shot2023.05 | 35.39 | |
| SciQ-smallvariant=small2022.09 | 30.62 | |
| SciQ-basevariant=base2022.09 | 27.39 |