Text Classification on IMDb (val)
89.13Top-1 AccCCT-2/2x1
Evaluation Results
| Method | Links | |
|---|---|---|
| CCT-2/2x1# Params=0.276 M2021.04 | 89.13 | |
| CCT-2/1x1# Params=0.238 M2021.04 | 88.95 | |
| CCT-4/2x1# Params=0.474 M2021.04 | 88.94 | |
| CCT-2/4x1# Params=0.353 M2021.04 | 88.92 | |
| CCT-4/4x1# Params=0.551 M2021.04 | 88.86 | |
| CCT-6/1x1# Params=3.237 M2021.04 | 88.81 | |
| CCT-6/2x1# Params=3.313 M2021.04 | 88.74 | |
| CCT-4/1x1# Params=0.436 M2021.04 | 88.71 | |
| CCT-6/4x1# Params=3.467 M2021.04 | 88.68 | |
| ViT-Lite-2/1# Params=0.238 M2021.04 | 87.69 | |
| CVT-2/1# Params=0.238 M2021.04 | 87.68 | |
| ViT-Lite-6/1# Params=3.237 M2021.04 | 87.58 | |
| ViT-Lite-2/2# Params=0.276 M2021.04 | 87.39 | |
| ViT-Lite-4/1# Params=0.436 M2021.04 | 87.38 | |
| CVT-4/1# Params=0.436 M2021.04 | 87.27 | |
| DistilBERTPLM=Gold Data, Setting=SUPERVISED, #Param=66M2022.02 | 87.24 | |
| ViT-Lite-4/2# Params=0.474 M2021.04 | 87 | |
| CVT-2/2# Params=0.276 M2021.04 | 86.99 | |
| ViT-Lite-6/2# Params=3.313 M2021.04 | 86.96 | |
| CVT-4/2# Params=0.474 M2021.04 | 86.96 | |
| CVT-6/1# Params=3.237 M2021.04 | 86.78 | |
| CVT-4/4# Params=0.551 M2021.04 | 86.77 | |
| ViT-Lite-4/4# Params=0.551 M2021.04 | 86.71 | |
| CVT-6/2# Params=3.313 M2021.04 | 86.61 | |
| ViT-Lite-6/4# Params=3.467 M2021.04 | 86.42 | |
| CVT-2/4# Params=0.353 M2021.04 | 86.39 | |
| ViT-Lite-2/4# Params=0.353 M2021.04 | 86.17 | |
| CVT-6/4# Params=3.467 M2021.04 | 86.13 | |
| Transformer-2# Params=1.086 M2021.04 | 86.01 | |
| Transformer-4# Params=2.171 M2021.04 | 85.98 | |
| Transformer-6# Params=4.337 M2021.04 | 85.87 | |
| LSTMPLM=Gold Data, Setting=SUPERVISED, #Param=~7M2022.02 | 84.6 | |
| ZeroGenPLM=GPT2-XL, TAM=DistilBERT, Setting=ZEROGEN, #Param=66M2022.02 | 84.28 | |
| ZeroGenPLM=GPT2-Large, TAM=DistilBERT, Setting=ZEROGEN, #Param=66M2022.02 | 83.56 | |
| GPT2-XLSetting=PROMPTING, #Param=1.5B2022.02 | 80.64 | |
| GPT2-LargeSetting=PROMPTING, #Param=762M2022.02 | 80.2 | |
| ZeroGenPLM=GPT2-XL, TAM=LSTM, Setting=ZEROGEN, #Param=~7M2022.02 | 79.8 | |
| ZeroGenPLM=GPT2-Large, TAM=LSTM, Setting=ZEROGEN, #Param=~7M2022.02 | 78.2 | |
| ZeroGenPLM=GPT2, TAM=DistilBERT, Setting=ZEROGEN, #Param=66M2022.02 | 73.24 | |
| ZeroGenPLM=GPT2, TAM=LSTM, Setting=ZEROGEN, #Param=~7M2022.02 | 69.6 | |
| GPT2Setting=PROMPTING, #Param=117M2022.02 | 51.52 |