Retrieval on LRA Document Retrieval reimplementation (test)
1.13Running Time (h)Linformer
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Linformer2021.10 | 1.13 | 1.89 | |
| Nystromformer2021.10 | 1.29 | 2.39 | |
| Performer2021.10 | 1.41 | 2.16 | |
| Reformer2021.10 | 1.73 | 2.98 | |
| Skyformer2021.10 | 1.86 | 3.15 | |
| Informer2021.10 | 2.91 | 5.77 | |
| BigBird2021.10 | 3.81 | 4.97 | |
| Kernelized Attention2021.10 | 7.46 | 10.46 | |
| Self-Attention2021.10 | 8.33 | 10.77 |