Resource Usage on LRA ListOps (test)
0.6Running Time (h)Linformer
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Linformer2021.10 | 0.6 | 0.99 | |
| Nystromformer2021.10 | 0.71 | 1.37 | |
| Performer2021.10 | 0.73 | 1.09 | |
| Reformer2021.10 | 0.85 | 1.61 | |
| Informer2021.10 | 1.19 | 4.85 | |
| Skyformer2021.10 | 1.29 | 1.75 | |
| BigBird2021.10 | 1.88 | 2.71 | |
| Kernelized Attention2021.10 | 1.99 | 5.94 | |
| Self-Attention2021.10 | 2.24 | 5.37 |