# Misclassification Detection on SMS Non-Spam class

Source: [Misclassification Detection on SMS Non-Spam class](<https://www.sota2.com/research/sota/misclassification-detection-on-sms-non-spam-class>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:26:18.804Z

Evaluation of misclassification detection performance on the SMS Non-Spam class dataset, reporting AUROC and False Rejection Rate at 95% True Rejection Threshold.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Misclassification Detection |
| Dataset (including any stated split) | SMS Non-Spam class |
| Metric | AUROC |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 26 of 26 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [AUROC](<https://www.sota2.com/research/sota/misclassification-detection-on-sms-non-spam-class.md?metric=AUROC>): Higher is better; unit: SCALAR.

- [FRR @ 95% TRR](<https://www.sota2.com/research/sota/misclassification-detection-on-sms-non-spam-class.md?metric=FRR%20%40%2095%25%20TRR>): Lower is better; unit: PERCENT.

## Recorded results

| Method | AUROC | Result date | Report paper |
| --- | --- | --- | --- |
| UQ-D | 0.9369 | Not recorded | 6995477609c33900fcd6d502 |
| UQ-D | 0.9028 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.8807 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.8802 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.8711 | Not recorded | 6995477609c33900fcd6d502 |
| UQ-D | 0.8638 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.8536 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.8253 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.8041 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.8041 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.8027 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.789 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.7741 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.7538 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.7277 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.6332 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.6323 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.6323 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.6287 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.6105 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.5722 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.5531 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.5531 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.5252 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.5249 | Not recorded | 6995477609c33900fcd6d502 |
| X-MAP | 0.4008 | Not recorded | 6995477609c33900fcd6d502 |

### UQ-D

AUROC: 0.9369. Result ID: 699abadf5698665ec448dcea.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"LogReg"}. This record does not assert independent reproduction.

### UQ-D

AUROC: 0.9028. Result ID: 699abadf5698665ec448dcf3.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"SVM"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.8807. Result ID: 699abadf5698665ec448dce2.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"LogReg","Topic Representation":"Original"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.8802. Result ID: 699abadf5698665ec448dce4.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"LogReg","Topic Representation":"Vacuity"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.8711. Result ID: 699abadf5698665ec448dce5.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"LogReg","Topic Representation":"Dissonance"}. This record does not assert independent reproduction.

### UQ-D

AUROC: 0.8638. Result ID: 699abadf5698665ec448dcfb.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"Naïve Bayes"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.8536. Result ID: 699abadf5698665ec448dce7.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"LogReg","Topic Representation":"D-alpha"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.8253. Result ID: 699abadf5698665ec448dce3.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"LogReg","Topic Representation":"Aleatory"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.8041. Result ID: 699abadf5698665ec448dce8.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"LogReg","Topic Representation":"D-beta"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.8041. Result ID: 699abadf5698665ec448dce9.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"LogReg","Topic Representation":"ODIN"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.8027. Result ID: 699abadf5698665ec448dcee.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"SVM","Topic Representation":"Dissonance"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.789. Result ID: 699abadf5698665ec448dceb.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"SVM","Topic Representation":"Original"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.7741. Result ID: 699abadf5698665ec448dced.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"SVM","Topic Representation":"Vacuity"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.7538. Result ID: 699abadf5698665ec448dcf0.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"SVM","Topic Representation":"D-alpha"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.7277. Result ID: 699abadf5698665ec448dcf4.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"Naïve Bayes","Topic Representation":"Original"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.6332. Result ID: 699abadf5698665ec448dcf5.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"Naïve Bayes","Topic Representation":"Aleatory"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.6323. Result ID: 699abadf5698665ec448dcf1.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"SVM","Topic Representation":"D-beta"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.6323. Result ID: 699abadf5698665ec448dcf2.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"SVM","Topic Representation":"ODIN"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.6287. Result ID: 699abadf5698665ec448dcf7.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"Naïve Bayes","Topic Representation":"Dissonance"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.6105. Result ID: 699abadf5698665ec448dcf8.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"Naïve Bayes","Topic Representation":"D-alpha"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.5722. Result ID: 699abadf5698665ec448dcec.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"SVM","Topic Representation":"Aleatory"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.5531. Result ID: 699abadf5698665ec448dcf9.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"Naïve Bayes","Topic Representation":"D-beta"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.5531. Result ID: 699abadf5698665ec448dcfa.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"Naïve Bayes","Topic Representation":"ODIN"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.5252. Result ID: 699abadf5698665ec448dce6.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"LogReg","Topic Representation":"REL-U"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.5249. Result ID: 699abadf5698665ec448dcf6.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"Naïve Bayes","Topic Representation":"Vacuity"}. This record does not assert independent reproduction.

### X-MAP

AUROC: 0.4008. Result ID: 699abadf5698665ec448dcef.

[Reporting paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6995477609c33900fcd6d502.md>)

Recorded evaluation configuration: {"Classifier":"SVM","Topic Representation":"REL-U"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
