Multiple Choice Question Answering on ARC Challenge (dev)
56.84AccuracyUnifiedQA_T5-FT
Evaluation results
| Method | Links | |
|---|---|---|
| UnifiedQA_T5-FTModel Size=LARGE, Protocol=Fine-Tuning2022.04 | 56.84 | |
| UnifiedQA_T5Model Size=LARGE2022.04 | 56.61 | |
| GenMC_T5Model Size=LARGE2022.04 | 49.83 | |
| UnifiedQA_T5-FTModel Size=BASE, Protocol=Fine-Tuning2022.04 | 45.31 | |
| UnifiedQA_T5Model Size=BASE2022.04 | 44.75 | |
| GenMC_T5Model Size=BASE2022.04 | 43.62 | |
| RoBERTaModel Size=BASE2022.04 | 38.64 | |
| RoBERTaModel Size=LARGE2022.04 | 38.08 | |
| ALBERTModel Size=BASE2022.04 | 34.8 | |
| ALBERTModel Size=LARGE2022.04 | 33.9 |