Document Classification on MIND (test)
0.8251AccuracyHi-Transformer
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Hi-Transformer2021.06 | 0.8251 | 0.6422 | |
| Poolingformer2021.08 | 0.8246 | 0.641 | |
| Fastformer2021.08 | 0.8234 | 0.6389 | |
| Linear Transformers2021.08 | 0.8225 | 0.6381 | |
| Linformer2021.08 | 0.8216 | 0.6377 | |
| BigBird2021.08 | 0.8193 | 0.6358 | |
| HI-BERT2021.06 | 0.8189 | 0.6363 | |
| BigBird2021.06 | 0.8181 | 0.6344 | |
| Longformer2021.06 | 0.8142 | 0.6268 | |
| Longformer2021.08 | 0.8136 | 0.6259 | |
| Transformermax sequence length=5122021.06 | 0.8096 | 0.5997 | |
| Transformer2021.08 | 0.809 | 0.6002 |