Text Classification on SST (val)
68.76Top-1 AccCCT-2/1x1
Evaluation Results
| Method | Links | |
|---|---|---|
| CCT-2/1x1# Params=0.238 M2021.04 | 68.76 | |
| CCT-4/1x1# Params=0.436 M2021.04 | 68.21 | |
| CVT-2/1# Params=0.238 M2021.04 | 67.88 | |
| ViT-Lite-2/1# Params=0.238 M2021.04 | 67.66 | |
| CCT-2/2x1# Params=0.276 M2021.04 | 67.19 | |
| Transformer-2# Params=1.086 M2021.04 | 67.15 | |
| ViT-Lite-4/1# Params=0.436 M2021.04 | 66.81 | |
| CVT-4/1# Params=0.436 M2021.04 | 66.64 | |
| CCT-6/1x1# Params=3.237 M2021.04 | 66.59 | |
| CCT-4/4x1# Params=0.551 M2021.04 | 66.57 | |
| CCT-4/2x1# Params=0.474 M2021.04 | 66.42 | |
| CVT-6/1# Params=3.237 M2021.04 | 65.94 | |
| CCT-6/4x1# Params=3.467 M2021.04 | 65.84 | |
| Transformer-4# Params=2.171 M2021.04 | 65.2 | |
| Transformer-6# Params=4.337 M2021.04 | 65.03 | |
| CCT-6/2x1# Params=3.313 M2021.04 | 65.02 | |
| ViT-Lite-6/1# Params=3.237 M2021.04 | 64.95 | |
| CVT-6/2# Params=3.313 M2021.04 | 64.57 | |
| CCT-2/4x1# Params=0.353 M2021.04 | 64.47 | |
| ViT-Lite-2/2# Params=0.276 M2021.04 | 64.44 | |
| CVT-2/2# Params=0.276 M2021.04 | 64.26 | |
| CVT-4/2# Params=0.474 M2021.04 | 63.9 | |
| ViT-Lite-4/2# Params=0.474 M2021.04 | 63.75 | |
| ViT-Lite-6/2# Params=3.313 M2021.04 | 62.78 | |
| ViT-Lite-2/4# Params=0.353 M2021.04 | 62.37 | |
| CVT-2/4# Params=0.353 M2021.04 | 62.22 | |
| CVT-4/4# Params=0.551 M2021.04 | 61.98 | |
| CVT-6/4# Params=3.467 M2021.04 | 61.63 | |
| ViT-Lite-6/4# Params=3.467 M2021.04 | 60.97 | |
| ViT-Lite-4/4# Params=0.551 M2021.04 | 60.83 |