Sequence Modeling on LRA ListOps
38.36AccuracyTransformer-LS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Transformer-LSversion=best2021.07 | 38.36 | 0.16 | |
| Dynamic Projectionversion=best2021.07 | 37.79 | 0.15 | |
| Transformer-LSw=8, r=322021.07 | 37.5 | 0.2 | |
| Linformerk=2562021.07 | 37.38 | 0.41 | |
| Nyströmformerl=1282021.07 | 37.34 | 0.61 | |
| Full Attention2021.07 | 37.13 | 1.21 | |
| Reformerconfig=22021.07 | 36.44 | 0.27 | |
| Performerr=2562021.07 | 32.78 | 0.41 |