# Watermarking Robustness on LVLM Evaluation Set (test)

Source: [Watermarking Robustness on LVLM Evaluation Set (test)](<https://www.sota2.com/research/sota/watermarking-robustness-on-lvlm-evaluation-set-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:01:53.720Z

Evaluation of model robustness against digital watermarking attacks or extraction methods applied to the LVLM Evaluation Set (test split), measured by relative and absolute performance changes.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Watermarking Robustness |
| Dataset (including any stated split) | LVLM Evaluation Set (test) |
| Metric | Relative Drop |
| Unit | PERCENT |
| Direction | Lower is better |
| Results loaded | 36 of 36 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Relative Drop](<https://www.sota2.com/research/sota/watermarking-robustness-on-lvlm-evaluation-set-test.md?metric=Relative%20Drop>): Lower is better; unit: PERCENT.

- [Absolute Performance](<https://www.sota2.com/research/sota/watermarking-robustness-on-lvlm-evaluation-set-test.md?metric=Absolute%20Performance>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Relative Drop | Result date | Report paper |
| --- | --- | --- | --- |
| KGW | 0 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| SynthID | 0 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| IE | 0 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| MorphMark | 0 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| VLA-Mark | 0 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| AGMark | 0 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| KGW | 0.07 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| KGW | 0.11 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| KGW | 0.2 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| KGW | 0.24 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| AGMark | 0.7 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| AGMark | 0.71 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| AGMark | 0.82 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| MorphMark | 0.83 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| AGMark | 0.87 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| MorphMark | 1.52 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| VLA-Mark | 1.71 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| IE | 1.76 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| VLA-Mark | 1.82 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| IE | 1.86 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| IE | 1.96 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| MorphMark | 2.08 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| MorphMark | 2.95 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| VLA-Mark | 3.34 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| IE | 3.55 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| VLA-Mark | 4.13 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| SynthID | 6.66 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| SynthID | 6.97 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| SynthID | 9.06 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| SynthID | 10.46 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| AGMark | 11.28 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| KGW | 11.84 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| IE | 13.25 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| MorphMark | 16.46 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| VLA-Mark | 26.36 | Not recorded | 698c0d55c97a0b3e3b5e1379 |
| SynthID | 36.32 | Not recorded | 698c0d55c97a0b3e3b5e1379 |

### KGW

Relative Drop: 0. Result ID: 69971d7b5698665ec46b9136.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73131e209131cea5a4b7.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Unattacked"}. This record does not assert independent reproduction.

### SynthID

Relative Drop: 0. Result ID: 69971d7b5698665ec46b913c.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Unattacked"}. This record does not assert independent reproduction.

### IE

Relative Drop: 0. Result ID: 69971d7b5698665ec46b9142.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78ab1e209131cea79c44.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Unattacked"}. This record does not assert independent reproduction.

### MorphMark

Relative Drop: 0. Result ID: 69971d7b5698665ec46b9148.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a91e209131cea79b09.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Unattacked"}. This record does not assert independent reproduction.

### VLA-Mark

Relative Drop: 0. Result ID: 69971d7b5698665ec46b914e.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b651e209131cea882cd.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Unattacked"}. This record does not assert independent reproduction.

### AGMark

Relative Drop: 0. Result ID: 69971d7b5698665ec46b9154.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Unattacked"}. This record does not assert independent reproduction.

### KGW

Relative Drop: 0.07. Result ID: 69971d7b5698665ec46b9137.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73131e209131cea5a4b7.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Insert"}. This record does not assert independent reproduction.

### KGW

Relative Drop: 0.11. Result ID: 69971d7b5698665ec46b9138.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73131e209131cea5a4b7.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Delete"}. This record does not assert independent reproduction.

### KGW

Relative Drop: 0.2. Result ID: 69971d7b5698665ec46b9139.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73131e209131cea5a4b7.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Synonym"}. This record does not assert independent reproduction.

### KGW

Relative Drop: 0.24. Result ID: 69971d7b5698665ec46b913a.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73131e209131cea5a4b7.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Translate"}. This record does not assert independent reproduction.

### AGMark

Relative Drop: 0.7. Result ID: 69971d7b5698665ec46b9155.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Insert"}. This record does not assert independent reproduction.

### AGMark

Relative Drop: 0.71. Result ID: 69971d7b5698665ec46b9156.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Delete"}. This record does not assert independent reproduction.

### AGMark

Relative Drop: 0.82. Result ID: 69971d7b5698665ec46b9158.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Translate"}. This record does not assert independent reproduction.

### MorphMark

Relative Drop: 0.83. Result ID: 69971d7b5698665ec46b9149.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a91e209131cea79b09.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Insert"}. This record does not assert independent reproduction.

### AGMark

Relative Drop: 0.87. Result ID: 69971d7b5698665ec46b9157.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Synonym"}. This record does not assert independent reproduction.

### MorphMark

Relative Drop: 1.52. Result ID: 69971d7b5698665ec46b914a.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a91e209131cea79b09.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Delete"}. This record does not assert independent reproduction.

### VLA-Mark

Relative Drop: 1.71. Result ID: 69971d7b5698665ec46b9150.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b651e209131cea882cd.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Delete"}. This record does not assert independent reproduction.

### IE

Relative Drop: 1.76. Result ID: 69971d7b5698665ec46b9144.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78ab1e209131cea79c44.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Delete"}. This record does not assert independent reproduction.

### VLA-Mark

Relative Drop: 1.82. Result ID: 69971d7b5698665ec46b914f.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b651e209131cea882cd.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Insert"}. This record does not assert independent reproduction.

### IE

Relative Drop: 1.86. Result ID: 69971d7b5698665ec46b9146.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78ab1e209131cea79c44.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Translate"}. This record does not assert independent reproduction.

### IE

Relative Drop: 1.96. Result ID: 69971d7b5698665ec46b9143.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78ab1e209131cea79c44.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Insert"}. This record does not assert independent reproduction.

### MorphMark

Relative Drop: 2.08. Result ID: 69971d7b5698665ec46b914b.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a91e209131cea79b09.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Synonym"}. This record does not assert independent reproduction.

### MorphMark

Relative Drop: 2.95. Result ID: 69971d7b5698665ec46b914c.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a91e209131cea79b09.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Translate"}. This record does not assert independent reproduction.

### VLA-Mark

Relative Drop: 3.34. Result ID: 69971d7b5698665ec46b9151.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b651e209131cea882cd.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Synonym"}. This record does not assert independent reproduction.

### IE

Relative Drop: 3.55. Result ID: 69971d7b5698665ec46b9145.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78ab1e209131cea79c44.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Synonym"}. This record does not assert independent reproduction.

### VLA-Mark

Relative Drop: 4.13. Result ID: 69971d7b5698665ec46b9152.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b651e209131cea882cd.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Translate"}. This record does not assert independent reproduction.

### SynthID

Relative Drop: 6.66. Result ID: 69971d7b5698665ec46b913d.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Insert"}. This record does not assert independent reproduction.

### SynthID

Relative Drop: 6.97. Result ID: 69971d7b5698665ec46b913e.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Delete"}. This record does not assert independent reproduction.

### SynthID

Relative Drop: 9.06. Result ID: 69971d7b5698665ec46b913f.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Synonym"}. This record does not assert independent reproduction.

### SynthID

Relative Drop: 10.46. Result ID: 69971d7b5698665ec46b9140.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Translate"}. This record does not assert independent reproduction.

### AGMark

Relative Drop: 11.28. Result ID: 69971d7b5698665ec46b9159.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Paraphrase"}. This record does not assert independent reproduction.

### KGW

Relative Drop: 11.84. Result ID: 69971d7b5698665ec46b913b.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73131e209131cea5a4b7.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Paraphrase"}. This record does not assert independent reproduction.

### IE

Relative Drop: 13.25. Result ID: 69971d7b5698665ec46b9147.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78ab1e209131cea79c44.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Paraphrase"}. This record does not assert independent reproduction.

### MorphMark

Relative Drop: 16.46. Result ID: 69971d7b5698665ec46b914d.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a91e209131cea79b09.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Paraphrase"}. This record does not assert independent reproduction.

### VLA-Mark

Relative Drop: 26.36. Result ID: 69971d7b5698665ec46b9153.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b651e209131cea882cd.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Paraphrase"}. This record does not assert independent reproduction.

### SynthID

Relative Drop: 36.32. Result ID: 69971d7b5698665ec46b9141.

[Reporting paper](<https://www.sota2.com/research/paper/698c0d55c97a0b3e3b5e1379.md>)

Recorded evaluation configuration: {"Adversarial Attack Type":"Paraphrase"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
