Topic Classification on Reddit (test)
0.8422AccuracyGold
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GoldTraining Set=Original training set2023.06 | 0.8422 | 0.8338 | — | |
| LLM Zero-ShotMode=Zero-shot predictor2023.06 | 0.67 | 0.5666 | 2.89 | |
| AttrPromptTraining Set=Synthetic data created with AttrPrompt2023.06 | 0.6333 | 0.631 | 0.84 | |
| AttrPrompt w/o CAFTraining Set=Synthetic data created with AttrPrompt without CAF2023.06 | 0.6122 | 0.6018 | 0.72 | |
| MetaPromptTraining Set=Synthetic data created with MetaPrompt2023.06 | 0.5461 | 0.543 | 0.74 | |
| SimPromptTraining Set=Synthetic data created with SimPrompt2023.06 | 0.5348 | 0.5381 | 0.65 |