Out-of-scope Intent Detection on Banking77 (r=2.5% contamination, test)
0.818AUC2 (10% Subset)ZS
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ZSEncoder=MPNET, Contamination Ratio=2.5%2024.05 | 0.818 | 0.818 | 0.818 | 0.818 | |
| ZSEncoder=MPNET, Contamination Ratio=7.5%2024.05 | 0.818 | 0.818 | 0.818 | 0.818 | |
| ColdFusionEncoder=MPNET, Contamination Ratio=2.5%2024.05 | 0.806 | 0.817 | 0.825 | 0.832 | |
| ColdFusionEncoder=MPNET, Contamination Ratio=7.5%2024.05 | 0.799 | 0.811 | 0.818 | 0.826 | |
| ColdFusionEncoder=GTE, Contamination Ratio=2.5%2024.05 | 0.79 | 0.809 | 0.818 | 0.823 | |
| ZSEncoder=GTE, Contamination Ratio=2.5%2024.05 | 0.789 | 0.789 | 0.789 | 0.789 | |
| ZSEncoder=GTE, Contamination Ratio=7.5%2024.05 | 0.789 | 0.789 | 0.789 | 0.789 | |
| ColdFusionEncoder=GTE, Contamination Ratio=7.5%2024.05 | 0.774 | 0.789 | 0.799 | 0.808 | |
| DN2Encoder=MPNET, Contamination Ratio=2.5%2024.05 | 0.766 | 0.791 | 0.801 | 0.805 | |
| DN2Encoder=GTE, Contamination Ratio=2.5%2024.05 | 0.746 | 0.775 | 0.788 | 0.792 | |
| DN2Encoder=MPNET, Contamination Ratio=7.5%2024.05 | 0.723 | 0.745 | 0.753 | 0.753 | |
| DN2Encoder=GTE, Contamination Ratio=7.5%2024.05 | 0.706 | 0.725 | 0.734 | 0.738 |