Long Document Classification on Long-document-dataset (test)
84.55AccuracyParamixer
Evaluation Results
| Method | Links | |
|---|---|---|
| ParamixerSequence Length (N)=32k2022.04 | 84.55 | |
| ParamixerSequence Length (N)=16k2022.04 | 83.89 | |
| NyströmformerSequence Length (N)=16k2022.04 | 71.7 | |
| Transformer-LSSequence Length (N)=16k2022.04 | 70.25 | |
| NyströmformerSequence Length (N)=32k2022.04 | 67.69 | |
| LinformerSequence Length (N)=32k2022.04 | 65.36 | |
| LinformerSequence Length (N)=16k2022.04 | 64.69 | |
| Transformer-LSSequence Length (N)=32k2022.04 | 60.93 | |
| TransformerSequence Length (N)=16k2022.04 | 25.62 | |
| TransformerSequence Length (N)=32k2022.04 | 25.62 | |
| PerformerSequence Length (N)=16k2022.04 | 25.62 | |
| PerformerSequence Length (N)=32k2022.04 | 25.2 | |
| ReformerSequence Length (N)=16k2022.04 | 25.04 | |
| ReformerSequence Length (N)=32k2022.04 | 25.04 |