Long Range Arena
Benchmarks
TaskDatasetSOTA resultTrendResults
Long Range Arena (LRA) (test)
90.69Accuracy (Text)
196
Long Range Arena (LRA)
90.53Text Accuracy
177
Long-Range Arena (LRA)
99.6Steps per second
84
Long Range Arena (LRA) v1 (test)
63.14ListOps
66
Long Range Arena (val)
62.75ListOps Accuracy
26
Long Range Arena 100 tokens
85.5ListOps Accuracy
14
Long Range Arena (LRA) Pathfinder (test)
96.7Accuracy
12
Long Range Arena (LRA) ListOps (test)
62.8Accuracy
12
Long Range Arena (test)
82.08Accuracy
7
Long Range Arena (LRA)
66.69Text (4K) Acc
5
Long Range Arena (LRA) (full suite)
60.45ListOps
5