# Backdoor Defense (Multimodal) on CC3M 60K subset 1.0 (test)

Source: [Backdoor Defense (Multimodal) on CC3M 60K subset 1.0 (test)](<https://www.sota2.com/research/sota/backdoor-defense-multimodal-on-cc3m-60k-subset-1-0-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-30T07:36:41.348Z

Evaluation of multimodal backdoor defense mechanisms on the CC3M 60K subset 1.0 test set, reporting metrics such as Clean Accuracy (CA), Perturbation Accuracy (PA), AUC, and Attack Success Rate (ASR).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Backdoor Defense (Multimodal) |
| Dataset (including any stated split) | CC3M 60K subset 1.0 (test) |
| Metric | Clean Accuracy (CA) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 7 of 7 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Clean Accuracy (CA)](<https://www.sota2.com/research/sota/backdoor-defense-multimodal-on-cc3m-60k-subset-1-0-test.md?metric=Clean%20Accuracy%20(CA)>): Higher is better; unit: PERCENT.

- [Perturbation Accuracy (PA)](<https://www.sota2.com/research/sota/backdoor-defense-multimodal-on-cc3m-60k-subset-1-0-test.md?metric=Perturbation%20Accuracy%20(PA)>): Higher is better; unit: PERCENT.

- [AUC](<https://www.sota2.com/research/sota/backdoor-defense-multimodal-on-cc3m-60k-subset-1-0-test.md?metric=AUC>): Higher is better; unit: PERCENT.

- [Attack Success Rate (ASR)](<https://www.sota2.com/research/sota/backdoor-defense-multimodal-on-cc3m-60k-subset-1-0-test.md?metric=Attack%20Success%20Rate%20(ASR)>): Lower is better; unit: PERCENT.

## Recorded results

| Method | Clean Accuracy (CA) | Result date | Report paper |
| --- | --- | --- | --- |
| Platonic Defense | 64.03 | Not recorded | 6a434d7dba73165dbb74395b |
| Decomp | 53.34 | Not recorded | 6a434d7dba73165dbb74395b |
| No Defense | 52.13 | Not recorded | 6a434d7dba73165dbb74395b |
| ZIP | 41.97 | Not recorded | 6a434d7dba73165dbb74395b |
| DeDe | 15.6 | Not recorded | 6a434d7dba73165dbb74395b |

### Platonic Defense

Clean Accuracy (CA): 64.03. Result ID: 6a4371eefbc373592c93ad3a.

[Reporting paper](<https://www.sota2.com/research/paper/6a434d7dba73165dbb74395b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a434d7dba73165dbb74395b.md>)

Recorded evaluation configuration: {"Evaluation protocol":"zero-shot","Attack":"Average (Backdoor attacks on image-text encoders)"}. This record does not assert independent reproduction.

### Decomp

Clean Accuracy (CA): 53.34. Result ID: 6a4371eefbc373592c93ad35.

[Reporting paper](<https://www.sota2.com/research/paper/6a434d7dba73165dbb74395b.md>)

Recorded evaluation configuration: {"Evaluation protocol":"zero-shot","Attack":"Average (Backdoor attacks on image-text encoders)"}. This record does not assert independent reproduction.

### No Defense

Clean Accuracy (CA): 52.13. Result ID: 6a4371eefbc373592c93ad34.

[Reporting paper](<https://www.sota2.com/research/paper/6a434d7dba73165dbb74395b.md>)

Recorded evaluation configuration: {"Evaluation protocol":"zero-shot","Attack":"Average (Backdoor attacks on image-text encoders)"}. This record does not assert independent reproduction.

### ZIP

Clean Accuracy (CA): 41.97. Result ID: 6a4371eefbc373592c93ad37.

[Reporting paper](<https://www.sota2.com/research/paper/6a434d7dba73165dbb74395b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71021e209131cea4e7cd.md>)

[Implementation](<https://github.com/sycny/ZIP>)

Recorded evaluation configuration: {"Evaluation protocol":"zero-shot","Attack":"Average (Backdoor attacks on image-text encoders)"}. This record does not assert independent reproduction.

### DeDe

Clean Accuracy (CA): 15.6. Result ID: 6a4371eefbc373592c93ad36.

[Reporting paper](<https://www.sota2.com/research/paper/6a434d7dba73165dbb74395b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa777e1e209131cea738c3.md>)

[Implementation](<https://github.com/tardisblue9/DeDe>)

Recorded evaluation configuration: {"Evaluation protocol":"zero-shot","Attack":"Average (Backdoor attacks on image-text encoders)"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
