Question Answering on DROP (val)
80F1 ScoreByT5
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| ByT5Model Size=XXL2021.05 | 80 | 78.5 | — | — | — | — | — | — | |
| ByT5Model Size=Large2021.05 | 74.4 | 73 | — | — | — | — | — | — | |
| ByT5Model Size=Base2021.05 | 72.6 | 71.2 | — | — | — | — | — | — | |
| mT5Model Size=XXL2021.05 | 71.2 | 69.6 | — | — | — | — | — | — | |
| ByT5Model Size=XL2021.05 | 68.7 | 67.2 | — | — | — | — | — | — | |
| ByT5Model Size=Small2021.05 | 66.6 | 65.1 | — | — | — | — | — | — | |
| mT5Model Size=XL2021.05 | 62.7 | 61.1 | — | — | — | — | — | — | |
| mT5Model Size=Large2021.05 | 58.7 | 57.3 | — | — | — | — | — | — | |
| mT5Model Size=Base2021.05 | 47.2 | 45.6 | — | — | — | — | — | — | |
| mT5Model Size=Small2021.05 | 40 | 38.4 | — | — | — | — | — | — | |
| GENERATIONBackbone=BART-base2023.06 | — | — | 60.07 | 57.15 | 58.58 | 75.39 | 72.39 | 73.86 | |
| ITERATIVEBackbone=RoBERTa2023.06 | — | — | 60.66 | 60.07 | 60.36 | 76.19 | 76.04 | 76.11 | |
| NUMPREDBackbone=RoBERTa2023.06 | — | — | 61.59 | 56.77 | 59.09 | 76.71 | 74.86 | 75.77 | |
| TAGGINGBackbone=RoBERTa2023.06 | — | — | 61.86 | 63.91 | 62.87 | 77.53 | 77.39 | 77.46 |