Open-set selective classification on TREC-10 (test)
96.6AUACCCL + Gold Data
Evaluation Results
| Method | Links | |
|---|---|---|
| CCL + Gold DataLoss=CCL, Outlier Set=Gold Data, Is Oracle=true2022.11 | 96.6 | |
| OE + Gold DataLoss=OE, Outlier Set=Gold Data, Is Oracle=true2022.11 | 96.5 | |
| CCL + Gold LabelLoss=CCL, Outlier Set=Gold Label, Is Oracle=true2022.11 | 94.8 | |
| CoNALLoss=CCL, Outlier Set=Novelty Prompting2022.11 | 94.3 | |
| kFolden2022.11 | 93.5 | |
| CCL + Few-ShotLoss=CCL, Outlier Set=Few-Shot2022.11 | 93.5 | |
| OE + WikitextLoss=OE, Outlier Set=Wikitext2022.11 | 92.6 | |
| CCL + Zero-ShotLoss=CCL, Outlier Set=Zero-Shot2022.11 | 92.5 | |
| ContrastiveLoss=Contrastive2022.11 | 92 | |
| CCL + WikitextLoss=CCL, Outlier Set=Wikitext2022.11 | 91.2 | |
| VanillaLoss=Vanilla cross-entropy2022.11 | 89.2 | |
| OE + Novelty PromptingLoss=OE, Outlier Set=Novelty Prompting2022.11 | 83.6 |