# Out-of-scope Intent Detection on CLINC-Banking (C-Bank) r=2.5% contamination (test)

Source: [Out-of-scope Intent Detection on CLINC-Banking (C-Bank) r=2.5% contamination (test)](<https://www.sota2.com/research/sota/out-of-scope-intent-detection-on-clinc-banking-c-bank-r-2-5-percent-contamination-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:25:19.905Z

Evaluation of Out-of-scope Intent Detection performance on the CLINC-Banking dataset subset specified with 2.5% contamination, measured using AUC metrics at various thresholds.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Out-of-scope Intent Detection |
| Dataset (including any stated split) | CLINC-Banking (C-Bank) r=2.5% contamination (test) |
| Metric | AUC (10% Contamination) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 12 of 12 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [AUC (10% Contamination)](<https://www.sota2.com/research/sota/out-of-scope-intent-detection-on-clinc-banking-c-bank-r-2-5-percent-contamination-test.md?metric=AUC%20(10%25%20Contamination)>): Higher is better; unit: PERCENT.

- [AUC (25% Contamination)](<https://www.sota2.com/research/sota/out-of-scope-intent-detection-on-clinc-banking-c-bank-r-2-5-percent-contamination-test.md?metric=AUC%20(25%25%20Contamination)>): Higher is better; unit: PERCENT.

- [AUC (50% Contamination)](<https://www.sota2.com/research/sota/out-of-scope-intent-detection-on-clinc-banking-c-bank-r-2-5-percent-contamination-test.md?metric=AUC%20(50%25%20Contamination)>): Higher is better; unit: PERCENT.

- [AUC (100% Contamination)](<https://www.sota2.com/research/sota/out-of-scope-intent-detection-on-clinc-banking-c-bank-r-2-5-percent-contamination-test.md?metric=AUC%20(100%25%20Contamination)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | AUC (10% Contamination) | Result date | Report paper |
| --- | --- | --- | --- |
| ColdFusion | 87 | Not recorded | 68fa73601e209131cea5c0a8 |
| ColdFusion | 85.5 | Not recorded | 68fa73601e209131cea5c0a8 |
| ColdFusion | 85.1 | Not recorded | 68fa73601e209131cea5c0a8 |
| ColdFusion | 83.4 | Not recorded | 68fa73601e209131cea5c0a8 |
| ZS | 83.1 | Not recorded | 68fa73601e209131cea5c0a8 |
| ZS | 83.1 | Not recorded | 68fa73601e209131cea5c0a8 |
| ZS | 82.7 | Not recorded | 68fa73601e209131cea5c0a8 |
| ZS | 82.7 | Not recorded | 68fa73601e209131cea5c0a8 |
| DN2 | 74.7 | Not recorded | 68fa73601e209131cea5c0a8 |
| DN2 | 72.8 | Not recorded | 68fa73601e209131cea5c0a8 |
| DN2 | 71.2 | Not recorded | 68fa73601e209131cea5c0a8 |
| DN2 | 67.2 | Not recorded | 68fa73601e209131cea5c0a8 |

### ColdFusion

AUC (10% Contamination): 87. Result ID: 6992d5e33a6c31484911d146.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Implementation](<https://github.com/talreiss/ColdFusion>)

Recorded evaluation configuration: {"Encoder":"MPNET","Contamination Ratio":"2.5%"}. This record does not assert independent reproduction.

### ColdFusion

AUC (10% Contamination): 85.5. Result ID: 6992d5e33a6c31484911d158.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Implementation](<https://github.com/talreiss/ColdFusion>)

Recorded evaluation configuration: {"Encoder":"MPNET","Contamination Ratio":"7.5%"}. This record does not assert independent reproduction.

### ColdFusion

AUC (10% Contamination): 85.1. Result ID: 6992d5e33a6c31484911d143.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Implementation](<https://github.com/talreiss/ColdFusion>)

Recorded evaluation configuration: {"Encoder":"GTE","Contamination Ratio":"2.5%"}. This record does not assert independent reproduction.

### ColdFusion

AUC (10% Contamination): 83.4. Result ID: 6992d5e33a6c31484911d155.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Implementation](<https://github.com/talreiss/ColdFusion>)

Recorded evaluation configuration: {"Encoder":"GTE","Contamination Ratio":"7.5%"}. This record does not assert independent reproduction.

### ZS

AUC (10% Contamination): 83.1. Result ID: 6992d5e33a6c31484911d141.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eea1e209131cea42e2d.md>)

Recorded evaluation configuration: {"Encoder":"GTE","Contamination Ratio":"2.5%"}. This record does not assert independent reproduction.

### ZS

AUC (10% Contamination): 83.1. Result ID: 6992d5e33a6c31484911d153.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eea1e209131cea42e2d.md>)

Recorded evaluation configuration: {"Encoder":"GTE","Contamination Ratio":"7.5%"}. This record does not assert independent reproduction.

### ZS

AUC (10% Contamination): 82.7. Result ID: 6992d5e33a6c31484911d144.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eea1e209131cea42e2d.md>)

Recorded evaluation configuration: {"Encoder":"MPNET","Contamination Ratio":"2.5%"}. This record does not assert independent reproduction.

### ZS

AUC (10% Contamination): 82.7. Result ID: 6992d5e33a6c31484911d156.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eea1e209131cea42e2d.md>)

Recorded evaluation configuration: {"Encoder":"MPNET","Contamination Ratio":"7.5%"}. This record does not assert independent reproduction.

### DN2

AUC (10% Contamination): 74.7. Result ID: 6992d5e33a6c31484911d145.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a911e209131cea28ebd.md>)

[Implementation](<https://github.com/talreiss/PANDA>)

Recorded evaluation configuration: {"Encoder":"MPNET","Contamination Ratio":"2.5%"}. This record does not assert independent reproduction.

### DN2

AUC (10% Contamination): 72.8. Result ID: 6992d5e33a6c31484911d157.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a911e209131cea28ebd.md>)

[Implementation](<https://github.com/talreiss/PANDA>)

Recorded evaluation configuration: {"Encoder":"MPNET","Contamination Ratio":"7.5%"}. This record does not assert independent reproduction.

### DN2

AUC (10% Contamination): 71.2. Result ID: 6992d5e33a6c31484911d142.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a911e209131cea28ebd.md>)

[Implementation](<https://github.com/talreiss/PANDA>)

Recorded evaluation configuration: {"Encoder":"GTE","Contamination Ratio":"2.5%"}. This record does not assert independent reproduction.

### DN2

AUC (10% Contamination): 67.2. Result ID: 6992d5e33a6c31484911d154.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a911e209131cea28ebd.md>)

[Implementation](<https://github.com/talreiss/PANDA>)

Recorded evaluation configuration: {"Encoder":"GTE","Contamination Ratio":"7.5%"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
