Machine Reading Comprehension on NQ (dev)
52.2Span F1ROBERTADM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ROBERTADMtdecode=11h2021.05 | 52.2 | 70.1 | |
| VAULTtdecode=40m2021.05 | 51.6 | 70.4 | |
| Longformertdecode=22m, variant=without PAPR2021.05 | 49.5 | 65.6 | |
| VAULT (without GPO)tdecode=41m2021.05 | 49.1 | 67.6 |