Open-set selective classification on AGNews (test)
94.8AUACOE + Gold Data
Evaluation Results
| Method | Links | |
|---|---|---|
| OE + Gold DataLoss=OE, Outlier Set=Gold Data, Is Oracle=true2022.11 | 94.8 | |
| CCL + Gold DataLoss=CCL, Outlier Set=Gold Data, Is Oracle=true2022.11 | 93.5 | |
| CCL + Gold LabelLoss=CCL, Outlier Set=Gold Label, Is Oracle=true2022.11 | 91.4 | |
| OE + Novelty PromptingLoss=OE, Outlier Set=Novelty Prompting2022.11 | 90.6 | |
| CoNALLoss=CCL, Outlier Set=Novelty Prompting2022.11 | 90.5 | |
| CCL + Few-ShotLoss=CCL, Outlier Set=Few-Shot2022.11 | 89.7 | |
| CCL + Zero-ShotLoss=CCL, Outlier Set=Zero-Shot2022.11 | 89.1 | |
| OE + WikitextLoss=OE, Outlier Set=Wikitext2022.11 | 88.9 | |
| CCL + WikitextLoss=CCL, Outlier Set=Wikitext2022.11 | 88.6 | |
| VanillaLoss=Vanilla cross-entropy2022.11 | 87.9 | |
| ContrastiveLoss=Contrastive2022.11 | 87 | |
| kFolden2022.11 | 85.8 |