LRA
Benchmarks
TaskDatasetSOTA resultTrendResults
LRA (Long Range Arena) (test)
87.09Average Accuracy
105
LRA Text (test)
17.7Throughput (Steps/s)
32
LRA 92 (test)
63.14ListOps Accuracy
26
LRA Image N=1024 (test)
87.3Accuracy
23
LRA
60.95LISTOPS Accuracy
9
LRA reimplementation (test)
2.19Running Time (h)
9
LRA Document Retrieval reimplementation (test)
1.13Running Time (h)
9
LRA ListOps (test)
0.6Running Time (h)
9
LRA Text Classification reimplementation (test)
0.65Running Time (Hours)
9
LRA Text Retrieval @8000
80.9Accuracy
8
LRA Retrieval
82.3Accuracy
8
LRA Text
68.4Accuracy
8
LRA ListOps
38.36Accuracy
8
LRA Pathfinder
2.29Parameters (M)
7
LRA Retrieval
2.94Parameters
7
LRA Text
0.003Model Parameters (M)
7
LRA ListOps
1.42Parameters
7
LRA Image
3.03Model Parameters (M)
6
LRA Benchmark
67.9ListOps Accuracy
4