Topic Classification on Situation
46.6AccuracySBERT
Evaluation results
| Method | Links | |
|---|---|---|
| SBERTEvaluation Mode=Z-LaVI, Zero-shot=true, Labeled data pre-training=true2022.10 | 46.6 | |
| SimCSEEvaluation Mode=Z-LaVI, Zero-shot=true2022.10 | 44.4 | |
| SBERTEvaluation Mode=Original, Zero-shot=true, Labeled data pre-training=true2022.10 | 42.6 | |
| SimCSEEvaluation Mode=Original, Zero-shot=true2022.10 | 42.1 | |
| RoBERTa-L-mnliEvaluation Mode=Z-LaVI, Zero-shot=true, Labeled data pre-training=true2022.10 | 41.8 | |
| BART-L-mnliEvaluation Mode=Z-LaVI, Zero-shot=true, Labeled data pre-training=true2022.10 | 41.1 | |
| RoBERTa-L-mnliEvaluation Mode=Original, Zero-shot=true, Labeled data pre-training=true2022.10 | 40.7 | |
| BART-L-mnliEvaluation Mode=Original, Zero-shot=true, Labeled data pre-training=true2022.10 | 40.5 | |
| GPT-J-6BEvaluation Mode=Z-LaVI, Zero-shot=true2022.10 | 38.8 | |
| GPT-Neo-1.3BEvaluation Mode=Z-LaVI, Zero-shot=true2022.10 | 38.5 | |
| GPT-Neo-2.7BEvaluation Mode=Z-LaVI, Zero-shot=true2022.10 | 35.2 | |
| Z-LaVI w/o LMEvaluation Mode=Z-LaVI, Zero-shot=true2022.10 | 33.4 | |
| GPT-J-6BEvaluation Mode=Original, Zero-shot=true2022.10 | 21.9 | |
| GPT-Neo-1.3BEvaluation Mode=Original, Zero-shot=true2022.10 | 17.8 | |
| GPT-Neo-2.7BEvaluation Mode=Original, Zero-shot=true2022.10 | 13.6 | |
| RandomEvaluation Mode=Original, Zero-shot=true2022.10 | 9.1 |