Question Answering on Quail
88.13AccuracyUD+-XXL
Evaluation results
| Method | Links | |
|---|---|---|
| UD+-XXLMode=Fully-supervised, Backbone=T5-XXL encoder, Model Parameters=11B2022.11 | 88.13 | |
| Tay et al. (2022)Mode=Fully-supervised, Model Parameters=4x of UD (~44B)2022.11 | 87.2 | |
| FLAN-T5Model Variant=xlarge, Model Parameters=3B2023.07 | 86.3 | |
| FLAN-T5Model Variant=large, Model Parameters=780M2023.07 | 79.1 | |
| ALIGNModel Variant=large, Model Parameters=355M2023.07 | 78.6 | |
| ALIGNModel Variant=base, Model Parameters=125M2023.07 | 67.8 | |
| OLTQAFull Config=True2023.05 | 56.96 | |
| UnifiedQA2023.05 | 53.31 |