Long-document Classification on Arxiv Long-Document 32K
91.1AccuracyRACE
Evaluation Results
| Method | Links | |
|---|---|---|
| RACEP=4, L=4, Train runtime (s)=300, Test runtime (s)=162025.10 | 91.1 | |
| RACEP=3, L=3, Train runtime (s)=289, Test runtime (s)=15.62025.10 | 90.6 | |
| FlashAttention2Train runtime (s)=471, Test runtime (s)=202025.10 | 89.7 | |
| RACEP=2, L=2, Train runtime (s)=282, Test runtime (s)=152025.10 | 89.4 | |
| Linformerk=128, Train runtime (s)=296, Test runtime (s)=10.72025.10 | 87.5 | |
| Linear AttentionTrain runtime (s)=286, Test runtime (s)=15.92025.10 | 87.3 | |
| Performerm=256, Train runtime (s)=449, Test runtime (s)=24.62025.10 | 86.5 |