Out-of-scope Intent Detection on CLINC-Cards (C-Cards) r=2.5% contamination (test)
85.2AUC2 (10%)ColdFusion
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ColdFusionEncoder=GTE, Contamination Ratio=2.5%2024.05 | 85.2 | 87.6 | 88.7 | 89.1 | |
| ColdFusionEncoder=MPNET, Contamination Ratio=2.5%2024.05 | 85.2 | 87.6 | 89 | 89.1 | |
| ZSEncoder=GTE, Contamination Ratio=2.5%2024.05 | 81.8 | 81.8 | 81.8 | 81.8 | |
| ZSEncoder=MPNET, Contamination Ratio=2.5%2024.05 | 80.1 | 80.1 | 80.1 | 80.1 | |
| DN2Encoder=GTE, Contamination Ratio=2.5%2024.05 | 71.6 | 79.1 | 82.9 | 85.7 | |
| DN2Encoder=MPNET, Contamination Ratio=2.5%2024.05 | 70.7 | 78.5 | 82.7 | 84.8 |