Few-shot Text Classification on 26 Class->Class Transfer Tasks (test)
54.98AccuracySelf-LLMDA
Evaluation results
| Method | Links | |
|---|---|---|
| Self-LLMDAModel Scale=350m2024.04 | 54.98 | |
| Self-LLMDAModel Scale=125m2024.04 | 51.72 | |
| Sentence ReorderModel Scale=1.3b, Augmentation Group=Manual-LLMDA2024.04 | 48.98 | |
| Self-LLMDAModel Scale=1.3b2024.04 | 48.8 | |
| POS AugmentModel Scale=1.3b, Augmentation Group=Manual-LLMDA2024.04 | 47.51 | |
| Word ReplaceModel Scale=1.3b, Augmentation Group=Manual-LLMDA2024.04 | 46.53 | |
| Word2vec InsertModel Scale=125m, Augmentation Group=Non-LLMDA2024.04 | 46.47 | |
| Contextual ReplaceModel Scale=350m, Augmentation Group=Manual-LLMDA2024.04 | 46.26 | |
| Back TranslationModel Scale=1.3b, Augmentation Group=Non-LLMDA2024.04 | 46.23 | |
| Word ReplaceModel Scale=350m, Augmentation Group=Manual-LLMDA2024.04 | 45.94 | |
| Word SwapModel Scale=1.3b, Augmentation Group=Manual-LLMDA2024.04 | 45.9 | |
| Mask PredictModel Scale=1.3b, Augmentation Group=Manual-LLMDA2024.04 | 45.87 | |
| Paragraph ShuffleModel Scale=1.3b, Augmentation Group=Manual-LLMDA2024.04 | 45.8 | |
| Back TranslationModel Scale=125m, Augmentation Group=Manual-LLMDA2024.04 | 45.79 | |
| Paragraph ShuffleModel Scale=125m, Augmentation Group=Manual-LLMDA2024.04 | 45.78 | |
| Grammar TransformModel Scale=350m, Augmentation Group=Manual-LLMDA2024.04 | 45.62 | |
| ParaphraseModel Scale=125m, Augmentation Group=Manual-LLMDA2024.04 | 45.56 | |
| Word SwapModel Scale=125m, Augmentation Group=Manual-LLMDA2024.04 | 45.45 | |
| Grammar TransformModel Scale=125m, Augmentation Group=Manual-LLMDA2024.04 | 45.39 | |
| ParaphraseModel Scale=350m, Augmentation Group=Manual-LLMDA2024.04 | 45.3 | |
| Back TranslationModel Scale=1.3b, Augmentation Group=Manual-LLMDA2024.04 | 45.3 | |
| Word ReplaceModel Scale=125m, Augmentation Group=Manual-LLMDA2024.04 | 45.29 | |
| Char. InsertModel Scale=125m, Augmentation Group=Non-LLMDA2024.04 | 45.03 | |
| Grammar TransformModel Scale=1.3b, Augmentation Group=Manual-LLMDA2024.04 | 44.98 | |
| POS AugmentModel Scale=125m, Augmentation Group=Manual-LLMDA2024.04 | 44.97 | |
| Char. SwapModel Scale=125m, Augmentation Group=Non-LLMDA2024.04 | 44.94 | |
| BERT Subs.Model Scale=125m, Augmentation Group=Non-LLMDA2024.04 | 44.88 | |
| Spell ErrorModel Scale=125m, Augmentation Group=Non-LLMDA2024.04 | 44.82 | |
| Word Insert/DeleteModel Scale=1.3b, Augmentation Group=Manual-LLMDA2024.04 | 44.82 | |
| OriginalModel Scale=125m2024.04 | 44.8 | |
| Word Insert/DeleteModel Scale=125m, Augmentation Group=Manual-LLMDA2024.04 | 44.8 | |
| Char. PerturbModel Scale=125m, Augmentation Group=Manual-LLMDA2024.04 | 44.72 | |
| Data MixModel Scale=125m, Augmentation Group=Manual-LLMDA2024.04 | 44.63 | |
| Word SwapModel Scale=350m, Augmentation Group=Non-LLMDA2024.04 | 44.56 | |
| POS AugmentModel Scale=350m, Augmentation Group=Manual-LLMDA2024.04 | 44.48 | |
| BERT Subs.Model Scale=1.3b, Augmentation Group=Non-LLMDA2024.04 | 44.45 | |
| Spell ErrorModel Scale=1.3b, Augmentation Group=Non-LLMDA2024.04 | 44.38 | |
| Word Insert/DeleteModel Scale=350m, Augmentation Group=Manual-LLMDA2024.04 | 44.27 | |
| Word DeleteModel Scale=125m, Augmentation Group=Non-LLMDA2024.04 | 44.24 | |
| Word2vec Subs.Model Scale=125m, Augmentation Group=Non-LLMDA2024.04 | 44.24 | |
| Back TranslationModel Scale=125m, Augmentation Group=Non-LLMDA2024.04 | 44.19 | |
| Sentence ReorderModel Scale=125m, Augmentation Group=Manual-LLMDA2024.04 | 44.18 | |
| GPT2 InsertModel Scale=1.3b, Augmentation Group=Non-LLMDA2024.04 | 44.13 | |
| BERT Subs.Model Scale=350m, Augmentation Group=Non-LLMDA2024.04 | 44.01 | |
| Data MixModel Scale=350m, Augmentation Group=Manual-LLMDA2024.04 | 44.01 | |
| Back TranslationModel Scale=350m, Augmentation Group=Non-LLMDA2024.04 | 44 | |
| Char. DeleteModel Scale=125m, Augmentation Group=Non-LLMDA2024.04 | 43.98 | |
| Word DeleteModel Scale=1.3b, Augmentation Group=Non-LLMDA2024.04 | 43.9 | |
| Word2vec Subs.Model Scale=350m, Augmentation Group=Non-LLMDA2024.04 | 43.89 | |
| Word SwapModel Scale=350m, Augmentation Group=Manual-LLMDA2024.04 | 43.88 | |
| Char. Subs.Model Scale=125m, Augmentation Group=Non-LLMDA2024.04 | 43.87 | |
| Sentence ReorderModel Scale=350m, Augmentation Group=Manual-LLMDA2024.04 | 43.84 | |
| Word SwapModel Scale=125m, Augmentation Group=Non-LLMDA2024.04 | 43.83 | |
| Data MixModel Scale=1.3b, Augmentation Group=Manual-LLMDA2024.04 | 43.73 | |
| Char. OCRModel Scale=125m, Augmentation Group=Non-LLMDA2024.04 | 43.72 | |
| Char. OCRModel Scale=350m, Augmentation Group=Non-LLMDA2024.04 | 43.7 | |
| Char. OCRModel Scale=1.3b, Augmentation Group=Non-LLMDA2024.04 | 43.66 | |
| Char. PerturbModel Scale=350m, Augmentation Group=Manual-LLMDA2024.04 | 43.56 | |
| Contextual ReplaceModel Scale=125m, Augmentation Group=Manual-LLMDA2024.04 | 43.52 | |
| Back TranslationModel Scale=350m, Augmentation Group=Manual-LLMDA2024.04 | 43.38 | |
| GPT2 InsertModel Scale=125m, Augmentation Group=Non-LLMDA2024.04 | 43.37 | |
| GPT2 InsertModel Scale=350m, Augmentation Group=Non-LLMDA2024.04 | 43.36 | |
| Char. DeleteModel Scale=350m, Augmentation Group=Non-LLMDA2024.04 | 43.33 | |
| Char. PerturbModel Scale=1.3b, Augmentation Group=Manual-LLMDA2024.04 | 43.3 | |
| Contextual ReplaceModel Scale=1.3b, Augmentation Group=Manual-LLMDA2024.04 | 43.26 | |
| Mask PredictModel Scale=350m, Augmentation Group=Manual-LLMDA2024.04 | 43.15 | |
| Char. InsertModel Scale=350m, Augmentation Group=Non-LLMDA2024.04 | 43.14 | |
| Char. Subs.Model Scale=350m, Augmentation Group=Non-LLMDA2024.04 | 43.07 | |
| Mask PredictModel Scale=125m, Augmentation Group=Manual-LLMDA2024.04 | 42.83 | |
| OriginalModel Scale=1.3b2024.04 | 42.82 | |
| Word SwapModel Scale=1.3b, Augmentation Group=Non-LLMDA2024.04 | 42.75 | |
| Word2vec Subs.Model Scale=1.3b, Augmentation Group=Non-LLMDA2024.04 | 42.68 | |
| Spell ErrorModel Scale=350m, Augmentation Group=Non-LLMDA2024.04 | 42.66 | |
| ParaphraseModel Scale=1.3b, Augmentation Group=Manual-LLMDA2024.04 | 42.53 | |
| Word DeleteModel Scale=350m, Augmentation Group=Non-LLMDA2024.04 | 42.38 | |
| Char. DeleteModel Scale=1.3b, Augmentation Group=Non-LLMDA2024.04 | 42.35 | |
| Char. SwapModel Scale=1.3b, Augmentation Group=Non-LLMDA2024.04 | 42.28 | |
| Char. SwapModel Scale=350m, Augmentation Group=Non-LLMDA2024.04 | 42.22 | |
| Paragraph ShuffleModel Scale=350m, Augmentation Group=Manual-LLMDA2024.04 | 42.03 | |
| OriginalModel Scale=350m2024.04 | 41.94 | |
| Word2vec InsertModel Scale=1.3b, Augmentation Group=Non-LLMDA2024.04 | 41.86 | |
| Word2vec InsertModel Scale=350m, Augmentation Group=Non-LLMDA2024.04 | 41.8 | |
| Char. InsertModel Scale=1.3b, Augmentation Group=Non-LLMDA2024.04 | 41.19 | |
| Char. Subs.Model Scale=1.3b, Augmentation Group=Non-LLMDA2024.04 | 40.29 |