Out-of-Scope Query Detection on Banking77-OOS (test)
83.3AUC^2 (10%)ColdFusion
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ColdFusionEncoder=MPNET, Contamination (r)=5%2024.05 | 83.3 | 82.8 | 82.8 | 83 | |
| ZSEncoder=MPNET, Contamination (r)=5%2024.05 | 81.8 | 81.8 | 81.8 | 81.8 | |
| ColdFusionEncoder=GTE, Contamination (r)=5%2024.05 | 81.7 | 81.8 | 81.9 | 82.3 | |
| ZSEncoder=GTE, Contamination (r)=5%2024.05 | 78.9 | 78.9 | 78.9 | 78.9 | |
| DN2Encoder=MPNET, Contamination (r)=5%2024.05 | 78.3 | 78.2 | 76.9 | 76.3 | |
| DN2Encoder=GTE, Contamination (r)=5%2024.05 | 76.7 | 76.2 | 75.6 | 75.3 |