Text Classification on TREC (val)
93.54Top-1 AccCCT-4/2x1
Evaluation results
| Method | Links | |
|---|---|---|
| CCT-4/2x1# Params=0.474 M2021.04 | 93.54 | |
| CCT-4/4x1# Params=0.551 M2021.04 | 93.2 | |
| CCT-6/4x1# Params=3.467 M2021.04 | 92.96 | |
| Transformer-6# Params=4.337 M2021.04 | 92.78 | |
| CVT-4/1# Params=0.436 M2021.04 | 92.58 | |
| Transformer-4# Params=2.171 M2021.04 | 92.54 | |
| CCT-6/2x1# Params=3.313 M2021.04 | 92.1 | |
| CVT-6/1# Params=3.237 M2021.04 | 92.06 | |
| ViT-Lite-6/1# Params=3.237 M2021.04 | 91.92 | |
| CCT-2/2x1# Params=0.276 M2021.04 | 91.86 | |
| CCT-4/1x1# Params=0.436 M2021.04 | 91.84 | |
| CVT-6/4# Params=3.467 M2021.04 | 91.66 | |
| ViT-Lite-4/1# Params=0.436 M2021.04 | 91.5 | |
| CCT-2/4x1# Params=0.353 M2021.04 | 91.42 | |
| CCT-6/1x1# Params=3.237 M2021.04 | 91.22 | |
| CVT-6/2# Params=3.313 M2021.04 | 91.14 | |
| CCT-2/1x1# Params=0.238 M2021.04 | 90.86 | |
| CVT-2/1# Params=0.238 M2021.04 | 90.44 | |
| ViT-Lite-4/2# Params=0.474 M2021.04 | 90.42 | |
| Transformer-2# Params=1.086 M2021.04 | 90.4 | |
| ViT-Lite-6/4# Params=3.467 M2021.04 | 90.36 | |
| CVT-4/2# Params=0.474 M2021.04 | 90.36 | |
| ViT-Lite-2/1# Params=0.238 M2021.04 | 90.32 | |
| CVT-4/4# Params=0.551 M2021.04 | 90.14 | |
| ViT-Lite-2/2# Params=0.276 M2021.04 | 90.12 | |
| ViT-Lite-2/4# Params=90.002021.04 | 90 | |
| CVT-2/2# Params=0.276 M2021.04 | 89.96 | |
| CVT-2/4# Params=0.353 M2021.04 | 89.84 | |
| ViT-Lite-6/2# Params=3.313 M2021.04 | 89.38 | |
| ViT-Lite-4/4# Params=0.551 M2021.04 | 89.3 |