Open-set selective classification on TACRED (test)
96.2AUACOE + Gold Data
Evaluation Results
| Method | Links | |
|---|---|---|
| OE + Gold DataLoss=OE, Outlier Set=Gold Data, Is Oracle=true2022.11 | 96.2 | |
| CCL + Gold DataLoss=CCL, Outlier Set=Gold Data, Is Oracle=true2022.11 | 94.3 | |
| OE + Novelty PromptingLoss=OE, Outlier Set=Novelty Prompting2022.11 | 91.3 | |
| CoNALLoss=CCL, Outlier Set=Novelty Prompting2022.11 | 91.1 | |
| CCL + Gold LabelLoss=CCL, Outlier Set=Gold Label, Is Oracle=true2022.11 | 91 | |
| CCL + Few-ShotLoss=CCL, Outlier Set=Few-Shot2022.11 | 90.8 | |
| OE + WikitextLoss=OE, Outlier Set=Wikitext2022.11 | 89.8 | |
| VanillaLoss=Vanilla cross-entropy2022.11 | 89.6 | |
| CCL + WikitextLoss=CCL, Outlier Set=Wikitext2022.11 | 89.3 | |
| CCL + Zero-ShotLoss=CCL, Outlier Set=Zero-Shot2022.11 | 88.9 | |
| ContrastiveLoss=Contrastive2022.11 | 88.8 | |
| kFolden2022.11 | 84.9 |