Question Answering on RACE high
84.6AccuracyFLAN-T5
Evaluation results
| Method | Links | |
|---|---|---|
| FLAN-T5Model Variant=xlarge, Model Parameters=3B2023.07 | 84.6 | |
| ALIGNModel Variant=large, Model Parameters=355M2023.07 | 81.6 | |
| FLAN-T5Model Variant=large, Model Parameters=780M2023.07 | 78.3 | |
| LLaMA-2Model Size=70B, Evaluation Protocol=LAT2023.10 | 72.1 | |
| ALIGNModel Variant=base, Model Parameters=125M2023.07 | 68.8 | |
| LLaMA-2Model Size=13B, Evaluation Protocol=LAT2023.10 | 62.9 | |
| LLaMA-2Model Size=70B, Evaluation Protocol=Few-Shot2023.10 | 52.4 | |
| LLaMA-2Model Size=13B, Evaluation Protocol=Few-Shot2023.10 | 50 | |
| LLaMA-2Model Size=7B, Evaluation Protocol=Few-Shot2023.10 | 46.2 | |
| LLaMA-2Model Size=7B, Evaluation Protocol=LAT2023.10 | 45.9 |