Question Answering on TriviaQA Wikipedia domain
81EMLongT5
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LongT5Model Scale=xl, Input Length=16k, Attention=TGlobal2021.12 | 81 | 84.83 | |
| BigBird-ETCAttention=random attn2021.12 | 80.86 | 84.5 | |
| Fusion-in-Decoder2021.12 | 80.09 | 84.35 | |
| LongT5Model Scale=large, Input Length=16k, Attention=TGlobal2021.12 | 78.38 | 82.45 | |
| ReadTwice2021.12 | 76.86 | 80.85 | |
| LongT5Model Scale=base, Input Length=16k, Attention=TGlobal2021.12 | 74.67 | 78.9 |