Long-document Classification on Arxiv Long-Document 16K
71.3AccuracyRACE
Evaluation Results
| Method | Links | |
|---|---|---|
| RACEP=3, L=3, Train runtime (s)=82.4, Test runtime (s)=42025.10 | 71.3 | |
| RACEP=4, L=4, Train runtime (s)=84.7, Test runtime (s)=4.12025.10 | 70.8 | |
| RACEP=2, L=2, Train runtime (s)=80.5, Test runtime (s)=3.92025.10 | 70.3 | |
| FlashAttention2Train runtime (s)=95.7, Test runtime (s)=3.72025.10 | 69.8 | |
| Performerm=256, Train runtime (s)=128, Test runtime (s)=5.82025.10 | 68.9 | |
| Linear AttentionTrain runtime (s)=83.8, Test runtime (s)=42025.10 | 67.9 | |
| Linformerk=128, Train runtime (s)=86, Test runtime (s)=3.22025.10 | 64.1 |