Sequence Classification on LRA ListOps T=2,048 (val)
36.37AccuracyMHA
Evaluation Results
| Method | Links | |
|---|---|---|
| MHAOverhead=1.00×2026.04 | 36.37 | |
| BigBirdOverhead=1.00×2026.04 | 36.05 | |
| LongformerOverhead=1.00×2026.04 | 35.63 | |
| PerformerOverhead=0.50×2026.04 | 18.01 |
Loading the SOTA2 catalog…