Natural Language Inference on AXG (test)
73.6AccuracyFLAN-T5
Evaluation Results
| Method | Links | |
|---|---|---|
| FLAN-T5Model Variant=large, Parameters=780M, Evaluation Protocol=Zero-shot2023.07 | 73.6 | |
| ALIGNModel Variant=large, Parameters=355M, Evaluation Protocol=Zero-shot2023.07 | 72.5 | |
| ALIGNModel Variant=base, Parameters=125M, Evaluation Protocol=Zero-shot2023.07 | 59.8 | |
| FLAN-T5Model Variant=base, Parameters=250M, Evaluation Protocol=Zero-shot2023.07 | 53.4 |