Document Retrieval on LRA Retrieval
82.3AccuracyFull Attention
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Full Attention2021.07 | 82.3 | 9.14 | |
| Transformer-LSversion=best2021.07 | 81.95 | 2.17 | |
| Dynamic Projectionversion=best2021.07 | 81.86 | 2.17 | |
| Transformer-LSw=8, r=322021.07 | 81.79 | 0.8 | |
| Performerr=2562021.07 | 81.7 | 1.63 | |
| Nyströmformerl=1282021.07 | 81.29 | 2.03 | |
| Linformerk=2562021.07 | 79.37 | 1.62 | |
| Reformerconfig=22021.07 | 78.64 | 1.15 |