Residual Watermark Evaluation on WMVLM Residual Watermarks 1.0 (test)
0.952DwtDct PLCCWMVLM
Evaluation Results
| Method | Links | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| WMVLM2026.01 | 0.952 | 0.957 | 0.988 | 0.885 | 0.875 | 0.99 | 0.712 | 0.708 | 0.998 | 0.961 | 0.973 | 0.994 | 0.983 | 0.986 | 1 | 0.981 | 0.985 | 0.998 | |
| LLaVA-v1.6-7BModel Size=7B2026.01 | 0.376 | 0.4 | 0 | 0.127 | -0.224 | 0 | -0.098 | -0.316 | 0 | 0.741 | 0.617 | 0 | -0.033 | 0.577 | 0 | 0.106 | 0.436 | 0 | |
| Gemma-3-12BModel Size=12B2026.01 | 0.245 | 0.111 | 0.043 | -0.193 | -0.155 | 0.153 | 0.117 | 0.038 | 0.205 | 0.311 | 0.269 | 0.111 | 0.23 | 0.187 | 0.125 | 0.262 | 0.253 | 0.275 | |
| Qwen3-VL-8BModel Size=8B2026.01 | 0.205 | 0.5 | 0.002 | -0.146 | 0.004 | 0.01 | 0.146 | 0.169 | 0.016 | 0.953 | 0.961 | 0.004 | -0.311 | -0.24 | 0.014 | -0.167 | -0.299 | 0.048 | |
| Gemma-3-27BModel Size=27B2026.01 | 0.153 | 0.088 | 0.036 | -0.167 | -0.142 | 0.399 | 0.064 | 0.017 | 0.485 | -0.01 | -0.068 | 0.352 | 0.032 | 0.047 | 0.369 | 0.223 | 0.224 | 0.565 | |
| Gemini-3-Pro2026.01 | 0.09 | 0.028 | 0.002 | 0.043 | 0.092 | 0.419 | 0.159 | 0.123 | 0.784 | 0.188 | 0.152 | 0.316 | 0.071 | 0.062 | 0.736 | 0.17 | 0.14 | 0.828 | |
| Claude-Opus-4.52026.01 | 0.067 | 0.044 | 0.002 | -0.139 | -0.008 | 0.142 | 0.079 | 0.067 | 0.3 | -0.016 | -0.025 | 0.106 | 0.219 | 0.194 | 0.182 | 0.272 | 0.281 | 0.49 | |
| GPT-52026.01 | 0.064 | 0.013 | 0 | -0.07 | -0.025 | 0.514 | 0.008 | 0.037 | 0.722 | 0.211 | 0.206 | 0.386 | 0.067 | 0.052 | 0.5 | 0.163 | 0.173 | 0.796 | |
| Gemma-3-4BModel Size=4B2026.01 | 0.042 | -0.076 | 0.013 | -0.167 | -0.14 | 0.047 | 0.206 | 0.237 | 0.315 | 0.158 | 0.127 | 0.245 | -0.046 | -0.031 | 0.296 | 0.259 | 0.275 | 0.316 | |
| LLaVA-v1.6-13BModel Size=13B2026.01 | -0.066 | -0.086 | 0 | -0.035 | -0.007 | 0.008 | -0.225 | -0.243 | 0.009 | -0.093 | -0.106 | 0.009 | 0.009 | 0.017 | 0.015 | 0.109 | 0.145 | 0.003 | |
| Qwen3-VL-4BModel Size=4B2026.01 | -0.121 | 0.002 | 0.006 | 0.442 | 0.545 | 0.02 | -0.163 | -0.259 | 0.03 | 0.703 | 0.232 | 0.011 | 0.42 | 0.326 | 0.02 | 0.166 | -0.01 | 0.081 | |
| Qwen3-VL-32BModel Size=32B2026.01 | -0.135 | -0.137 | 0 | 0.013 | -0.094 | 0.044 | -0.042 | -0.063 | 0.154 | 0.278 | 0.307 | 0.034 | -0.064 | -0.056 | 0.065 | -0.222 | -0.21 | 0.217 |