# Multimodal Watermarking on AMBER

Source: [Multimodal Watermarking on AMBER](<https://www.sota2.com/research/sota/multimodal-watermarking-on-amber>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-27T11:24:26.032Z

Evaluation of Multimodal Watermarking techniques on the AMBER dataset, reporting metrics including AUC, Perplexity (PPL), BertScore, and Chair-I score.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Multimodal Watermarking |
| Dataset (including any stated split) | AMBER |
| Metric | PPL |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [PPL](<https://www.sota2.com/research/sota/multimodal-watermarking-on-amber.md?metric=PPL>): Lower is better; unit: SCALAR.

- [AUC](<https://www.sota2.com/research/sota/multimodal-watermarking-on-amber.md?metric=AUC>): Higher is better; unit: PERCENT.

- [BertScore](<https://www.sota2.com/research/sota/multimodal-watermarking-on-amber.md?metric=BertScore>): Higher is better; unit: PERCENT.

- [Chair-I Score](<https://www.sota2.com/research/sota/multimodal-watermarking-on-amber.md?metric=Chair-I%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | PPL | Result date | Report paper |
| --- | --- | --- | --- |
| NW | 2.98 | Not recorded | 6965d19a6343fa78c8323688 |
| VLA | 3.03 | Not recorded | 6965d19a6343fa78c8323688 |
| VISA-M | 3.03 | Not recorded | 6965d19a6343fa78c8323688 |
| KGW | 3.06 | Not recorded | 6965d19a6343fa78c8323688 |
| DiP | 3.13 | Not recorded | 6965d19a6343fa78c8323688 |
| Unbiased | 3.13 | Not recorded | 6965d19a6343fa78c8323688 |
| SWEET | 3.15 | Not recorded | 6965d19a6343fa78c8323688 |
| NW | 5.6 | Not recorded | 6965d19a6343fa78c8323688 |
| VISA-M | 5.91 | Not recorded | 6965d19a6343fa78c8323688 |
| VLA | 6.04 | Not recorded | 6965d19a6343fa78c8323688 |
| KGW | 6.08 | Not recorded | 6965d19a6343fa78c8323688 |
| SWEET | 6.1 | Not recorded | 6965d19a6343fa78c8323688 |
| Unbiased | 6.36 | Not recorded | 6965d19a6343fa78c8323688 |
| DiP | 6.38 | Not recorded | 6965d19a6343fa78c8323688 |

### NW

PPL: 2.98. Result ID: 69a17edd35dfcabb00e76eaa.

[Reporting paper](<https://www.sota2.com/research/paper/6965d19a6343fa78c8323688.md>)

Recorded evaluation configuration: {"Model":"Qwen"}. This record does not assert independent reproduction.

### VLA

PPL: 3.03. Result ID: 69a17edd35dfcabb00e76eab.

[Reporting paper](<https://www.sota2.com/research/paper/6965d19a6343fa78c8323688.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b651e209131cea882cd.md>)

Recorded evaluation configuration: {"Model":"Qwen"}. This record does not assert independent reproduction.

### VISA-M

PPL: 3.03. Result ID: 69a17edd35dfcabb00e76eb0.

[Reporting paper](<https://www.sota2.com/research/paper/6965d19a6343fa78c8323688.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6965d19a6343fa78c8323688.md>)

Recorded evaluation configuration: {"Model":"Qwen"}. This record does not assert independent reproduction.

### KGW

PPL: 3.06. Result ID: 69a17edd35dfcabb00e76eac.

[Reporting paper](<https://www.sota2.com/research/paper/6965d19a6343fa78c8323688.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73131e209131cea5a4b7.md>)

Recorded evaluation configuration: {"Model":"Qwen"}. This record does not assert independent reproduction.

### DiP

PPL: 3.13. Result ID: 69a17edd35dfcabb00e76eae.

[Reporting paper](<https://www.sota2.com/research/paper/6965d19a6343fa78c8323688.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73e01e209131cea5e9b1.md>)

Recorded evaluation configuration: {"Model":"Qwen"}. This record does not assert independent reproduction.

### Unbiased

PPL: 3.13. Result ID: 69a17edd35dfcabb00e76eaf.

[Reporting paper](<https://www.sota2.com/research/paper/6965d19a6343fa78c8323688.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e51e209131cea4dc08.md>)

Recorded evaluation configuration: {"Model":"Qwen"}. This record does not assert independent reproduction.

### SWEET

PPL: 3.15. Result ID: 69a17edd35dfcabb00e76ead.

[Reporting paper](<https://www.sota2.com/research/paper/6965d19a6343fa78c8323688.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73ff1e209131cea5f1db.md>)

[Implementation](<https://github.com/hongcheki/sweet-watermark>)

Recorded evaluation configuration: {"Model":"Qwen"}. This record does not assert independent reproduction.

### NW

PPL: 5.6. Result ID: 69a17edd35dfcabb00e76ea3.

[Reporting paper](<https://www.sota2.com/research/paper/6965d19a6343fa78c8323688.md>)

Recorded evaluation configuration: {"Model":"LLaVA"}. This record does not assert independent reproduction.

### VISA-M

PPL: 5.91. Result ID: 69a17edd35dfcabb00e76ea9.

[Reporting paper](<https://www.sota2.com/research/paper/6965d19a6343fa78c8323688.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6965d19a6343fa78c8323688.md>)

Recorded evaluation configuration: {"Model":"LLaVA"}. This record does not assert independent reproduction.

### VLA

PPL: 6.04. Result ID: 69a17edd35dfcabb00e76ea4.

[Reporting paper](<https://www.sota2.com/research/paper/6965d19a6343fa78c8323688.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b651e209131cea882cd.md>)

Recorded evaluation configuration: {"Model":"LLaVA"}. This record does not assert independent reproduction.

### KGW

PPL: 6.08. Result ID: 69a17edd35dfcabb00e76ea5.

[Reporting paper](<https://www.sota2.com/research/paper/6965d19a6343fa78c8323688.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73131e209131cea5a4b7.md>)

Recorded evaluation configuration: {"Model":"LLaVA"}. This record does not assert independent reproduction.

### SWEET

PPL: 6.1. Result ID: 69a17edd35dfcabb00e76ea6.

[Reporting paper](<https://www.sota2.com/research/paper/6965d19a6343fa78c8323688.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73ff1e209131cea5f1db.md>)

[Implementation](<https://github.com/hongcheki/sweet-watermark>)

Recorded evaluation configuration: {"Model":"LLaVA"}. This record does not assert independent reproduction.

### Unbiased

PPL: 6.36. Result ID: 69a17edd35dfcabb00e76ea8.

[Reporting paper](<https://www.sota2.com/research/paper/6965d19a6343fa78c8323688.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e51e209131cea4dc08.md>)

Recorded evaluation configuration: {"Model":"LLaVA"}. This record does not assert independent reproduction.

### DiP

PPL: 6.38. Result ID: 69a17edd35dfcabb00e76ea7.

[Reporting paper](<https://www.sota2.com/research/paper/6965d19a6343fa78c8323688.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73e01e209131cea5e9b1.md>)

Recorded evaluation configuration: {"Model":"LLaVA"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.