Sentiment Analysis on Rotten Tomato
91.48AccuracyColD-Fusion
Evaluation Results
| Method | Links | |
|---|---|---|
| ColD-Fusion2022.12 | 91.48 | |
| Multitask2022.12 | 90.73 | |
| Finetune2022.12 | 88.03 | |
| Training-free Weight Recycling (L^T_KD)Distillation Data=Unlabeled Task Data, Source Dataset=SST-22023.05 | 87.8 | |
| Full dataset tuningTraining=Full dataset (FD)2023.05 | 87.4 | |
| NPM# Params=1.0x, Evaluation Protocol=Zero-shot, nonparametric=true2022.12 | 86 | |
| Training-free Weight Recycling (L^W_KD)Distillation Data=Wikipedia, Source Dataset=SST-22023.05 | 84.7 | |
| ProGenClassifier=DistillBERT2023.05 | 82.86 | |
| REGENClassifier=DistillBERT2023.05 | 81.42 | |
| RoBERTa# Params=1.0x, Evaluation Protocol=Zero-shot2022.12 | 81.1 | |
| GPT-2 kNN-LM# Params=2.2x, Evaluation Protocol=Zero-shot2022.12 | 80.6 | |
| SuperGenClassifier=DistillBERT2023.05 | 79.08 | |
| 32-shot tuningTraining=32-shot (FS)2023.05 | 78.7 | |
| PromptingClassifier=DistillBERT2023.05 | 78.66 | |
| ZeroGenClassifier=DistillBERT2023.05 | 78.36 | |
| MiningClassifier=DistillBERT2023.05 | 76.73 | |
| GPT-3 + PMI# Params=500x, Evaluation Protocol=Zero-shot2022.12 | 75.5 | |
| GPT-2 + PMI# Params=2.2x, Evaluation Protocol=Zero-shot2022.12 | 74.1 | |
| Demonstration learningMode=Zero-shot with context2023.05 | 71.4 | |
| T5# Params=2.2x, Evaluation Protocol=Zero-shot2022.12 | 59.1 | |
| MUPPET2022.12 | 58.1 | |
| T5 3B# Params=8.5x, Evaluation Protocol=Zero-shot2022.12 | 57.3 | |
| GPT-3# Params=500x, Evaluation Protocol=Zero-shot2022.12 | 57 | |
| GPT-2# Params=2.2x, Evaluation Protocol=Zero-shot2022.12 | 53 | |
| GPT-2 kNN# Params=2.2x, Evaluation Protocol=Zero-shot2022.12 | 49.1 |