Question Answering on Quartz (test)
90.2AccuracyFLAN-T5
Evaluation results
| Method | Links | |
|---|---|---|
| FLAN-T5Model Variant=large, Parameters=780M, Evaluation Protocol=Zero-shot2023.07 | 90.2 | |
| ALIGNModel Variant=large, Parameters=355M, Evaluation Protocol=Zero-shot2023.07 | 79.2 | |
| FLAN-T5Model Variant=base, Parameters=250M, Evaluation Protocol=Zero-shot2023.07 | 74.4 | |
| ALIGNModel Variant=base, Parameters=125M, Evaluation Protocol=Zero-shot2023.07 | 59.7 |