Out-of-scope intent detection on CLINC-CreditCards OOS (test)
86.4AUC (10% Threshold)ColdFusion
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ColdFusionEncoder=GTE, Contamination Ratio=7.5%2024.05 | 86.4 | 87.1 | 87.9 | 88.2 | — | |
| ColdFusionEncoder=MPNET, Contamination Ratio=7.5%2024.05 | 85.4 | 86.9 | 87.8 | 88 | — | |
| ColdFusionEncoder=GTE, Contamination (r)=5%2024.05 | 84.8 | 87.3 | 88.7 | — | 89 | |
| ColdFusionEncoder=MPNET, Contamination (r)=5%2024.05 | 84.1 | 86 | 87.8 | — | 88.3 | |
| ZSEncoder=GTE, Contamination Ratio=7.5%2024.05 | 81.8 | 81.8 | 81.8 | 81.8 | — | |
| ZSEncoder=GTE, Contamination (r)=5%2024.05 | 81.8 | 81.8 | 81.8 | — | 81.8 | |
| ZSEncoder=MPNET, Contamination Ratio=7.5%2024.05 | 80.1 | 80.1 | 80.1 | 80.1 | — | |
| ZSEncoder=MPNET, Contamination (r)=5%2024.05 | 80.1 | 80.1 | 80.1 | — | 80.1 | |
| DN2Encoder=GTE, Contamination Ratio=7.5%2024.05 | 71.3 | 78.1 | 81.1 | 81.9 | — | |
| DN2Encoder=MPNET, Contamination Ratio=7.5%2024.05 | 70.7 | 78 | 80.9 | 80.9 | — | |
| DN2Encoder=GTE, Contamination (r)=5%2024.05 | 70 | 75.6 | 80.2 | — | 80.2 | |
| DN2Encoder=MPNET, Contamination (r)=5%2024.05 | 69.8 | 76.9 | 80.9 | — | 81.1 |