# Out-of-scope Intent Detection on CLINC-Cards (C-Cards) r=2.5% contamination (test)

Source: [Out-of-scope Intent Detection on CLINC-Cards (C-Cards) r=2.5% contamination (test)](<https://www.sota2.com/research/sota/out-of-scope-intent-detection-on-clinc-cards-c-cards-r-2-5-percent-contamination-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:25:33.047Z

Evaluation of Out-of-scope Intent Detection performance on the test split of the CLINC-Cards dataset, specifically under conditions involving 2.5% contamination, measured using AUC metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Out-of-scope Intent Detection |
| Dataset (including any stated split) | CLINC-Cards (C-Cards) r=2.5% contamination (test) |
| Metric | AUC2 (10%) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 6 of 6 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [AUC2 (10%)](<https://www.sota2.com/research/sota/out-of-scope-intent-detection-on-clinc-cards-c-cards-r-2-5-percent-contamination-test.md?metric=AUC2%20(10%25)>): Higher is better; unit: PERCENT.

- [AUC2 (25%)](<https://www.sota2.com/research/sota/out-of-scope-intent-detection-on-clinc-cards-c-cards-r-2-5-percent-contamination-test.md?metric=AUC2%20(25%25)>): Higher is better; unit: PERCENT.

- [AUC2 (50%)](<https://www.sota2.com/research/sota/out-of-scope-intent-detection-on-clinc-cards-c-cards-r-2-5-percent-contamination-test.md?metric=AUC2%20(50%25)>): Higher is better; unit: PERCENT.

- [AUC2 (100%)](<https://www.sota2.com/research/sota/out-of-scope-intent-detection-on-clinc-cards-c-cards-r-2-5-percent-contamination-test.md?metric=AUC2%20(100%25)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | AUC2 (10%) | Result date | Report paper |
| --- | --- | --- | --- |
| ColdFusion | 85.2 | Not recorded | 68fa73601e209131cea5c0a8 |
| ColdFusion | 85.2 | Not recorded | 68fa73601e209131cea5c0a8 |
| ZS | 81.8 | Not recorded | 68fa73601e209131cea5c0a8 |
| ZS | 80.1 | Not recorded | 68fa73601e209131cea5c0a8 |
| DN2 | 71.6 | Not recorded | 68fa73601e209131cea5c0a8 |
| DN2 | 70.7 | Not recorded | 68fa73601e209131cea5c0a8 |

### ColdFusion

AUC2 (10%): 85.2. Result ID: 6992d5e33a6c31484911d149.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Implementation](<https://github.com/talreiss/ColdFusion>)

Recorded evaluation configuration: {"Encoder":"GTE","Contamination Ratio":"2.5%"}. This record does not assert independent reproduction.

### ColdFusion

AUC2 (10%): 85.2. Result ID: 6992d5e33a6c31484911d14c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Implementation](<https://github.com/talreiss/ColdFusion>)

Recorded evaluation configuration: {"Encoder":"MPNET","Contamination Ratio":"2.5%"}. This record does not assert independent reproduction.

### ZS

AUC2 (10%): 81.8. Result ID: 6992d5e33a6c31484911d147.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eea1e209131cea42e2d.md>)

Recorded evaluation configuration: {"Encoder":"GTE","Contamination Ratio":"2.5%"}. This record does not assert independent reproduction.

### ZS

AUC2 (10%): 80.1. Result ID: 6992d5e33a6c31484911d14a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eea1e209131cea42e2d.md>)

Recorded evaluation configuration: {"Encoder":"MPNET","Contamination Ratio":"2.5%"}. This record does not assert independent reproduction.

### DN2

AUC2 (10%): 71.6. Result ID: 6992d5e33a6c31484911d148.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a911e209131cea28ebd.md>)

[Implementation](<https://github.com/talreiss/PANDA>)

Recorded evaluation configuration: {"Encoder":"GTE","Contamination Ratio":"2.5%"}. This record does not assert independent reproduction.

### DN2

AUC2 (10%): 70.7. Result ID: 6992d5e33a6c31484911d14b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73601e209131cea5c0a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a911e209131cea28ebd.md>)

[Implementation](<https://github.com/talreiss/PANDA>)

Recorded evaluation configuration: {"Encoder":"MPNET","Contamination Ratio":"2.5%"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
