Text Classification on AGNews (val)
93.8Top-1 AccCCT-2/4x1
Evaluation Results
| Method | Links | |
|---|---|---|
| CCT-2/4x1# Params=0.353 M2021.04 | 93.8 | |
| CCT-6/1x1# Params=3.237 M2021.04 | 93.73 | |
| Transformer-6# Params=4.337 M2021.04 | 93.55 | |
| CVT-4/1# Params=0.436 M2021.04 | 93.53 | |
| CCT-4/1x1# Params=0.436 M2021.04 | 93.49 | |
| ViT-Lite-4/1# Params=0.436 M2021.04 | 93.48 | |
| CCT-2/1x1# Params=0.238 M2021.04 | 93.4 | |
| CVT-6/1# Params=3.237 M2021.04 | 93.38 | |
| CCT-2/2x1# Params=0.276 M2021.04 | 93.38 | |
| CCT-4/2x1# Params=0.474 M2021.04 | 93.3 | |
| CCT-6/2x1# Params=3.313 M2021.04 | 93.29 | |
| Transformer-2# Params=1.086 M2021.04 | 93.28 | |
| Transformer-4# Params=2.171 M2021.04 | 93.25 | |
| CVT-2/1# Params=0.238 M2021.04 | 93.24 | |
| CCT-4/4x1# Params=0.551 M2021.04 | 93.09 | |
| ViT-Lite-6/1# Params=3.237 M2021.04 | 93.07 | |
| ViT-Lite-2/1# Params=0.238 M2021.04 | 93.02 | |
| CCT-6/4x1# Params=3.467 M2021.04 | 92.86 | |
| CVT-6/2# Params=3.313 M2021.04 | 92.57 | |
| ViT-Lite-6/2# Params=3.313 M2021.04 | 92.56 | |
| CVT-4/2# Params=0.474 M2021.04 | 92.35 | |
| CVT-2/2# Params=0.276 M2021.04 | 92.29 | |
| ViT-Lite-2/2# Params=0.276 M2021.04 | 92.2 | |
| ViT-Lite-4/2# Params=0.474 M2021.04 | 92.06 | |
| CVT-6/4# Params=3.467 M2021.04 | 91.35 | |
| ViT-Lite-6/4# Params=3.467 M2021.04 | 91.12 | |
| CVT-2/4# Params=0.353 M2021.04 | 91.1 | |
| ViT-Lite-4/4# Params=0.551 M2021.04 | 90.93 | |
| CVT-4/4# Params=0.551 M2021.04 | 90.71 | |
| ViT-Lite-2/4# Params=0.353 M2021.04 | 90.53 |