Long Document Classification on LDC benchmark
93.8Overall Performance (HYP)Longformer
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Longformer2023.05 | 93.8 | 86.3 | 95.7 | 67.3 | 61.2 | 56.2 | 76.8 | |
| BigBird2023.05 | 92.2 | 82.3 | 95.2 | 67.4 | 63.6 | 63.7 | 77.4 | |
| HiPool-RoBERTaBackbone=RoBERTa2023.05 | 88.6 | 90.4 | 94.8 | 69 | 64.8 | 68.5 | 79.4 | |
| RoBERTaBackbone=RoBERTa2023.05 | 87.4 | 85.7 | 95.3 | 65 | 57.9 | 56 | 74.5 | |
| HiPool-BERTBackbone=BERT2023.05 | 86.5 | 90.8 | 93.1 | 66 | 61.2 | 65.1 | 77.1 | |
| ToBERT2023.05 | 86.2 | 90.1 | 92.4 | 58.7 | 56 | 61.1 | 74.1 | |
| BERTBackbone=BERT2023.05 | 85.7 | 85.3 | 91.3 | 59.2 | 50.3 | 55.6 | 71.2 |