# Safety Detection on Polyguard Education

Source: [Safety Detection on Polyguard Education](<https://www.sota2.com/research/sota/safety-detection-on-polyguard-education>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:26:05.344Z

Evaluation of model performance on Safety Detection using the Polyguard Education dataset, reporting AUROC and FPR@95.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Safety Detection |
| Dataset (including any stated split) | Polyguard Education |
| Metric | AUROC |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 18 of 18 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [AUROC](<https://www.sota2.com/research/sota/safety-detection-on-polyguard-education.md?metric=AUROC>): Higher is better; unit: PERCENT.

- [FPR@95](<https://www.sota2.com/research/sota/safety-detection-on-polyguard-education.md?metric=FPR%4095>): Lower is better; unit: PERCENT.

## Recorded results

| Method | AUROC | Result date | Report paper |
| --- | --- | --- | --- |
| T3 | 99.43 | Not recorded | 6984242aa8b01e76cc8ee806 |
| T3 | 99.13 | Not recorded | 6984242aa8b01e76cc8ee806 |
| LlamaGuard3 | 86.61 | Not recorded | 6984242aa8b01e76cc8ee806 |
| CIDER | 74.06 | Not recorded | 6984242aa8b01e76cc8ee806 |
| MDJudge | 69.09 | Not recorded | 6984242aa8b01e76cc8ee806 |
| WildGuard | 66.37 | Not recorded | 6984242aa8b01e76cc8ee806 |
| DuoGuard | 66.26 | Not recorded | 6984242aa8b01e76cc8ee806 |
| RMD | 65.05 | Not recorded | 6984242aa8b01e76cc8ee806 |
| GMM | 62.88 | Not recorded | 6984242aa8b01e76cc8ee806 |
| FDBD | 58.71 | Not recorded | 6984242aa8b01e76cc8ee806 |
| LlamaGuard3 | 57.4 | Not recorded | 6984242aa8b01e76cc8ee806 |
| LlamaGuard4 | 53.89 | Not recorded | 6984242aa8b01e76cc8ee806 |
| NNGUIDE | 50.38 | Not recorded | 6984242aa8b01e76cc8ee806 |
| VIM | 50.22 | Not recorded | 6984242aa8b01e76cc8ee806 |
| OPENMAX | 47.12 | Not recorded | 6984242aa8b01e76cc8ee806 |
| REACT | 44.78 | Not recorded | 6984242aa8b01e76cc8ee806 |
| Polyguard | 44.64 | Not recorded | 6984242aa8b01e76cc8ee806 |
| ADASCALE | 44.59 | Not recorded | 6984242aa8b01e76cc8ee806 |

### T3

AUROC: 99.43. Result ID: 69964c015698665ec4906163.

[Reporting paper](<https://www.sota2.com/research/paper/6984242aa8b01e76cc8ee806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6984242aa8b01e76cc8ee806.md>)

Recorded evaluation configuration: {"classifier":"OCSVM"}. This record does not assert independent reproduction.

### T3

AUROC: 99.13. Result ID: 69964c015698665ec4906162.

[Reporting paper](<https://www.sota2.com/research/paper/6984242aa8b01e76cc8ee806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6984242aa8b01e76cc8ee806.md>)

Recorded evaluation configuration: {"classifier":"GMM"}. This record does not assert independent reproduction.

### LlamaGuard3

AUROC: 86.61. Result ID: 69964c015698665ec490615e.

[Reporting paper](<https://www.sota2.com/research/paper/6984242aa8b01e76cc8ee806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa717b1e209131cea5186d.md>)

Recorded evaluation configuration: {"parameters":"1B","output\_format":"logits"}. This record does not assert independent reproduction.

### CIDER

AUROC: 74.06. Result ID: 69964c015698665ec4906153.

[Reporting paper](<https://www.sota2.com/research/paper/6984242aa8b01e76cc8ee806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e0a1e209131cea3d9c6.md>)

[Implementation](<https://github.com/deeplearning-wisc/MCM>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MDJudge

AUROC: 69.09. Result ID: 69964c015698665ec490615f.

[Reporting paper](<https://www.sota2.com/research/paper/6984242aa8b01e76cc8ee806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa738f1e209131cea5d389.md>)

[Implementation](<https://github.com/OpenSafetyLab/SALAD-BENCH>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### WildGuard

AUROC: 66.37. Result ID: 69964c015698665ec490615d.

[Reporting paper](<https://www.sota2.com/research/paper/6984242aa8b01e76cc8ee806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76291e209131cea6b9a6.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### DuoGuard

AUROC: 66.26. Result ID: 69964c015698665ec4906160.

[Reporting paper](<https://www.sota2.com/research/paper/6984242aa8b01e76cc8ee806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76e91e209131cea6fe2c.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RMD

AUROC: 65.05. Result ID: 69964c015698665ec4906159.

[Reporting paper](<https://www.sota2.com/research/paper/6984242aa8b01e76cc8ee806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eb81e209131cea41c6b.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GMM

AUROC: 62.88. Result ID: 69964c015698665ec4906155.

[Reporting paper](<https://www.sota2.com/research/paper/6984242aa8b01e76cc8ee806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64f91e209131cea077ac.md>)

[Implementation](<https://github.com/pokaxpoka/deep_Mahalanobis_detector>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### FDBD

AUROC: 58.71. Result ID: 69964c015698665ec4906154.

[Reporting paper](<https://www.sota2.com/research/paper/6984242aa8b01e76cc8ee806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73771e209131cea5cb2b.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### LlamaGuard3

AUROC: 57.4. Result ID: 69964c015698665ec490615b.

[Reporting paper](<https://www.sota2.com/research/paper/6984242aa8b01e76cc8ee806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa717b1e209131cea5186d.md>)

Recorded evaluation configuration: {"parameters":"1B"}. This record does not assert independent reproduction.

### LlamaGuard4

AUROC: 53.89. Result ID: 69964c015698665ec490615c.

[Reporting paper](<https://www.sota2.com/research/paper/6984242aa8b01e76cc8ee806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa717b1e209131cea5186d.md>)

Recorded evaluation configuration: {"parameters":"12B"}. This record does not assert independent reproduction.

### NNGUIDE

AUROC: 50.38. Result ID: 69964c015698665ec4906156.

[Reporting paper](<https://www.sota2.com/research/paper/6984242aa8b01e76cc8ee806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70ad1e209131cea4c735.md>)

[Implementation](<https://github.com/roomo7time/nnguide>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### VIM

AUROC: 50.22. Result ID: 69964c015698665ec490615a.

[Reporting paper](<https://www.sota2.com/research/paper/6984242aa8b01e76cc8ee806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c151e209131cea32091.md>)

[Implementation](<https://github.com/haoqiwang/vim>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### OPENMAX

AUROC: 47.12. Result ID: 69964c015698665ec4906157.

[Reporting paper](<https://www.sota2.com/research/paper/6984242aa8b01e76cc8ee806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa622a1e209131ce9f7cf0.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### REACT

AUROC: 44.78. Result ID: 69964c015698665ec4906158.

[Reporting paper](<https://www.sota2.com/research/paper/6984242aa8b01e76cc8ee806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b4f1e209131cea2d8b5.md>)

[Implementation](<https://github.com/deeplearning-wisc/react.git>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Polyguard

AUROC: 44.64. Result ID: 69964c015698665ec4906161.

[Reporting paper](<https://www.sota2.com/research/paper/6984242aa8b01e76cc8ee806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79a21e209131cea7e929.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### ADASCALE

AUROC: 44.59. Result ID: 69964c015698665ec4906152.

[Reporting paper](<https://www.sota2.com/research/paper/6984242aa8b01e76cc8ee806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa775a1e209131cea72a26.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
