# VLM Jailbreak Detection on VLM Jailbreak Average (MM-SafetyBench, JailBreakV-28K, FigImg)

Source: [VLM Jailbreak Detection on VLM Jailbreak Average (MM-SafetyBench, JailBreakV-28K, FigImg)](<https://www.sota2.com/research/sota/vlm-jailbreak-detection-on-vlm-jailbreak-average-mm-safetybench-jailbreakv-28k-figimg>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-08T07:52:32.595Z

Aggregate evaluation of Visual Language Model (VLM) performance in detecting jailbreaking attempts across the MM-SafetyBench, JailBreakV-28K, and FigImg datasets, reported using the average AUROC.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | VLM Jailbreak Detection |
| Dataset (including any stated split) | VLM Jailbreak Average (MM-SafetyBench, FigImg, JailBreakV-28K) |
| Metric | Average AUROC |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Average AUROC](<https://www.sota2.com/research/sota/vlm-jailbreak-detection-on-vlm-jailbreak-average-mm-safetybench-jailbreakv-28k-figimg.md?metric=Average%20AUROC>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Average AUROC | Result date | Report paper |
| --- | --- | --- | --- |
| MTK | 0.94 | Not recorded | 6a264ca990966ade919beb19 |
| HiddenDetect | 0.928 | Not recorded | 6a264ca990966ade919beb19 |
| MTK | 0.924 | Not recorded | 6a264ca990966ade919beb19 |
| HiddenDetect | 0.878 | Not recorded | 6a264ca990966ade919beb19 |
| ECSO | 0.825 | Not recorded | 6a264ca990966ade919beb19 |
| JailGuard | 0.809 | Not recorded | 6a264ca990966ade919beb19 |
| MirrorCheck | 0.708 | Not recorded | 6a264ca990966ade919beb19 |
| ECSO | 0.683 | Not recorded | 6a264ca990966ade919beb19 |
| MirrorCheck | 0.669 | Not recorded | 6a264ca990966ade919beb19 |
| CIDER | 0.655 | Not recorded | 6a264ca990966ade919beb19 |
| CIDER | 0.655 | Not recorded | 6a264ca990966ade919beb19 |
| JailDAM | 0.627 | Not recorded | 6a264ca990966ade919beb19 |
| JailDAM | 0.593 | Not recorded | 6a264ca990966ade919beb19 |
| JailGuard | 0.547 | Not recorded | 6a264ca990966ade919beb19 |

### MTK

Average AUROC: 0.94. Result ID: 6a2674acfbc373592c23037c.

[Reporting paper](<https://www.sota2.com/research/paper/6a264ca990966ade919beb19.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a264ca990966ade919beb19.md>)

Recorded evaluation configuration: {"VLM":"LLaVa"}. This record does not assert independent reproduction.

### HiddenDetect

Average AUROC: 0.928. Result ID: 6a2674acfbc373592c230376.

[Reporting paper](<https://www.sota2.com/research/paper/6a264ca990966ade919beb19.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79951e209131cea7e65c.md>)

Recorded evaluation configuration: {"VLM":"LLaVa"}. This record does not assert independent reproduction.

### MTK

Average AUROC: 0.924. Result ID: 6a2674acfbc373592c230383.

[Reporting paper](<https://www.sota2.com/research/paper/6a264ca990966ade919beb19.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a264ca990966ade919beb19.md>)

Recorded evaluation configuration: {"VLM":"Qwen-VL"}. This record does not assert independent reproduction.

### HiddenDetect

Average AUROC: 0.878. Result ID: 6a2674acfbc373592c23037d.

[Reporting paper](<https://www.sota2.com/research/paper/6a264ca990966ade919beb19.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79951e209131cea7e65c.md>)

Recorded evaluation configuration: {"VLM":"Qwen-VL"}. This record does not assert independent reproduction.

### ECSO

Average AUROC: 0.825. Result ID: 6a2674acfbc373592c230377.

[Reporting paper](<https://www.sota2.com/research/paper/6a264ca990966ade919beb19.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75321e209131cea6650e.md>)

Recorded evaluation configuration: {"VLM":"LLaVa"}. This record does not assert independent reproduction.

### JailGuard

Average AUROC: 0.809. Result ID: 6a2674acfbc373592c230381.

[Reporting paper](<https://www.sota2.com/research/paper/6a264ca990966ade919beb19.md>)

Recorded evaluation configuration: {"VLM":"Qwen-VL"}. This record does not assert independent reproduction.

### MirrorCheck

Average AUROC: 0.708. Result ID: 6a2674acfbc373592c23037f.

[Reporting paper](<https://www.sota2.com/research/paper/6a264ca990966ade919beb19.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75401e209131cea66d50.md>)

Recorded evaluation configuration: {"VLM":"Qwen-VL"}. This record does not assert independent reproduction.

### ECSO

Average AUROC: 0.683. Result ID: 6a2674acfbc373592c23037e.

[Reporting paper](<https://www.sota2.com/research/paper/6a264ca990966ade919beb19.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75321e209131cea6650e.md>)

Recorded evaluation configuration: {"VLM":"Qwen-VL"}. This record does not assert independent reproduction.

### MirrorCheck

Average AUROC: 0.669. Result ID: 6a2674acfbc373592c230378.

[Reporting paper](<https://www.sota2.com/research/paper/6a264ca990966ade919beb19.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75401e209131cea66d50.md>)

Recorded evaluation configuration: {"VLM":"LLaVa"}. This record does not assert independent reproduction.

### CIDER

Average AUROC: 0.655. Result ID: 6a2674acfbc373592c230379.

[Reporting paper](<https://www.sota2.com/research/paper/6a264ca990966ade919beb19.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75411e209131cea66d6f.md>)

Recorded evaluation configuration: {"VLM":"LLaVa"}. This record does not assert independent reproduction.

### CIDER

Average AUROC: 0.655. Result ID: 6a2674acfbc373592c230380.

[Reporting paper](<https://www.sota2.com/research/paper/6a264ca990966ade919beb19.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75411e209131cea66d6f.md>)

Recorded evaluation configuration: {"VLM":"Qwen-VL"}. This record does not assert independent reproduction.

### JailDAM

Average AUROC: 0.627. Result ID: 6a2674acfbc373592c23037b.

[Reporting paper](<https://www.sota2.com/research/paper/6a264ca990966ade919beb19.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a091e209131cea80b4a.md>)

Recorded evaluation configuration: {"VLM":"LLaVa"}. This record does not assert independent reproduction.

### JailDAM

Average AUROC: 0.593. Result ID: 6a2674acfbc373592c230382.

[Reporting paper](<https://www.sota2.com/research/paper/6a264ca990966ade919beb19.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a091e209131cea80b4a.md>)

Recorded evaluation configuration: {"VLM":"Qwen-VL"}. This record does not assert independent reproduction.

### JailGuard

Average AUROC: 0.547. Result ID: 6a2674acfbc373592c23037a.

[Reporting paper](<https://www.sota2.com/research/paper/6a264ca990966ade919beb19.md>)

Recorded evaluation configuration: {"VLM":"LLaVa"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
