Out-of-scope Intent Detection on CLINC-Banking (C-Bank) r=2.5% contamination (test)
87AUC (10% Contamination)ColdFusion
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ColdFusionEncoder=MPNET, Contamination Ratio=2.5%2024.05 | 87 | 89 | 89.5 | 90 | |
| ColdFusionEncoder=MPNET, Contamination Ratio=7.5%2024.05 | 85.5 | 88.1 | 88.9 | 89.2 | |
| ColdFusionEncoder=GTE, Contamination Ratio=2.5%2024.05 | 85.1 | 86.9 | 87.7 | 89.1 | |
| ColdFusionEncoder=GTE, Contamination Ratio=7.5%2024.05 | 83.4 | 87 | 88.4 | 88.9 | |
| ZSEncoder=GTE, Contamination Ratio=2.5%2024.05 | 83.1 | 83.1 | 83.1 | 83.1 | |
| ZSEncoder=GTE, Contamination Ratio=7.5%2024.05 | 83.1 | 83.1 | 83.1 | 83.1 | |
| ZSEncoder=MPNET, Contamination Ratio=2.5%2024.05 | 82.7 | 82.7 | 82.7 | 82.7 | |
| ZSEncoder=MPNET, Contamination Ratio=7.5%2024.05 | 82.7 | 82.7 | 82.7 | 82.7 | |
| DN2Encoder=MPNET, Contamination Ratio=2.5%2024.05 | 74.7 | 82.4 | 85.7 | 86.9 | |
| DN2Encoder=MPNET, Contamination Ratio=7.5%2024.05 | 72.8 | 82.4 | 84.8 | 84.1 | |
| DN2Encoder=GTE, Contamination Ratio=2.5%2024.05 | 71.2 | 79.4 | 82.9 | 84.7 | |
| DN2Encoder=GTE, Contamination Ratio=7.5%2024.05 | 67.2 | 77.5 | 80.5 | 80.8 |