Text Classification on LRA Text (test)
17.7Throughput (Steps/s)Fourier Transformer
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Fourier TransformerInput Length=4K2023.05 | 17.7 | 0.18 | |
| Fourier TransformerInput Length=3K2023.05 | 16.8 | 0.18 | |
| Fourier TransformerInput Length=2K2023.05 | 12.2 | 0.19 | |
| Fourier TransformerInput Length=1K2023.05 | 6.9 | 0.23 | |
| PerformerInput Length=4K2023.05 | 5.7 | 0.11 | |
| LinformerInput Length=4K2023.05 | 5.5 | 0.1 | |
| PerformerInput Length=3K2023.05 | 3.8 | 0.15 | |
| LinformerInput Length=3K2023.05 | 3.7 | 0.18 | |
| SynthesizerInput Length=3K2023.05 | 2.9 | 0.74 | |
| FSATInput Length=4K2023.05 | 2.5 | 0.16 | |
| FSATInput Length=3K2023.05 | 2 | 0.21 | |
| LinformerInput Length=2K2023.05 | 1.9 | 0.21 | |
| PerformerInput Length=2K2023.05 | 1.9 | 0.22 | |
| FSATInput Length=2K2023.05 | 1.5 | 0.27 | |
| SynthesizerInput Length=4K2023.05 | 1.4 | 0.74 | |
| BigBirdInput Length=3K2023.05 | 1.2 | 0.4 | |
| SynthesizerInput Length=2K2023.05 | 1.2 | 0.75 | |
| LinformerInput Length=1K2023.05 | 1.2 | 0.44 | |
| PerformerInput Length=1K2023.05 | 1.2 | 0.44 | |
| BigBirdInput Length=4K2023.05 | 1.1 | 0.3 | |
| SynthesizerInput Length=1K2023.05 | 1.1 | 0.76 | |
| FSATInput Length=1K2023.05 | 1.1 | 0.53 | |
| TransformerInput Length=1K2023.05 | 1 | 1 | |
| TransformerInput Length=2K2023.05 | 1 | 1 | |
| TransformerInput Length=3K2023.05 | 1 | 1 | |
| TransformerInput Length=4K2023.05 | 1 | 1 | |
| BigBirdInput Length=1K2023.05 | 0.9 | 0.91 | |
| ReformerInput Length=4K2023.05 | 0.8 | 0.24 | |
| BigBirdInput Length=2K2023.05 | 0.8 | 0.56 | |
| ReformerInput Length=3K2023.05 | 0.7 | 0.28 | |
| ReformerInput Length=1K2023.05 | 0.5 | 0.56 | |
| ReformerInput Length=2K2023.05 | 0.4 | 0.37 |