Out-of-Scope Query Detection on CLINC-Banking (C-Bank) (test)
84.4AUC (10% Threshold)ColdFusion
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ColdFusionEncoder=MPNET, Contamination (r)=5%2024.05 | 84.4 | 87.8 | 88.8 | 89.4 | |
| ZSEncoder=GTE, Contamination (r)=5%2024.05 | 83.1 | 83.1 | 83.1 | 83.1 | |
| ZSEncoder=MPNET, Contamination (r)=5%2024.05 | 82.7 | 82.7 | 82.7 | 82.7 | |
| ColdFusionEncoder=GTE, Contamination (r)=5%2024.05 | 82.3 | 87 | 88.6 | 89.2 | |
| DN2Encoder=MPNET, Contamination (r)=5%2024.05 | 69.7 | 78.9 | 77.6 | 83.6 | |
| DN2Encoder=GTE, Contamination (r)=5%2024.05 | 64.8 | 76 | 75.9 | 82.2 |