Watermark Detection on Vicuna-7b 16k 50 samples v1.5
0.986AUROC (Overall)RP4
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| RP4Attack Budget=0.052024.03 | 0.986 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP5Attack Budget=0.052024.03 | 0.986 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SICOAttack Budget=0.052024.03 | 0.986 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SICOAttack Budget=0.12024.03 | 0.986 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SICOAttack Budget=0.22024.03 | 0.986 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SICOAttack Budget=0.252024.03 | 0.986 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP1Attack Budget=0.252024.03 | 0.9856 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP2Attack Budget=0.252024.03 | 0.9856 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP3Attack Budget=0.252024.03 | 0.9856 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP4Attack Budget=0.252024.03 | 0.9856 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP5Attack Budget=0.252024.03 | 0.9856 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SICOAttack Budget=0.152024.03 | 0.9856 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RBAttack Budget=0.12024.03 | 0.9856 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP1Attack Budget=02024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP1Attack Budget=0.052024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP1Attack Budget=0.12024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP1Attack Budget=0.152024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP1Attack Budget=0.22024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP1Attack Budget=0.32024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP1Attack Budget=0.352024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP1Attack Budget=0.52024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP2Attack Budget=02024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP2Attack Budget=0.052024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP2Attack Budget=0.12024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP2Attack Budget=0.152024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP2Attack Budget=0.22024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP2Attack Budget=0.52024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP3Attack Budget=02024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP3Attack Budget=0.052024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP3Attack Budget=0.12024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP3Attack Budget=0.152024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP3Attack Budget=0.22024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP4Attack Budget=02024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP4Attack Budget=0.12024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP4Attack Budget=0.152024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP4Attack Budget=0.22024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP5Attack Budget=02024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP5Attack Budget=0.12024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP5Attack Budget=0.152024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP5Attack Budget=0.22024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SICOAttack Budget=02024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RBAttack Budget=02024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RBAttack Budget=0.052024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCTSAttack Budget=02024.03 | 0.9852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP1Attack Budget=0.42024.03 | 0.9848 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP2Attack Budget=0.32024.03 | 0.9848 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP3Attack Budget=0.32024.03 | 0.9848 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP4Attack Budget=0.32024.03 | 0.9848 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP5Attack Budget=0.32024.03 | 0.9848 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SICOAttack Budget=0.42024.03 | 0.9848 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RBAttack Budget=0.152024.03 | 0.9848 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RBAttack Budget=0.22024.03 | 0.9848 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP1Attack Budget=0.452024.03 | 0.9844 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP2Attack Budget=0.352024.03 | 0.9844 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP2Attack Budget=0.42024.03 | 0.9844 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP3Attack Budget=0.42024.03 | 0.9844 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP4Attack Budget=0.42024.03 | 0.9844 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP5Attack Budget=0.42024.03 | 0.9844 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP2Attack Budget=0.452024.03 | 0.984 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP3Attack Budget=0.452024.03 | 0.984 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP4Attack Budget=0.352024.03 | 0.984 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP4Attack Budget=0.452024.03 | 0.984 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP5Attack Budget=0.352024.03 | 0.984 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SICOAttack Budget=0.452024.03 | 0.984 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP3Attack Budget=0.52024.03 | 0.9836 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SICOAttack Budget=0.352024.03 | 0.9836 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RBAttack Budget=0.252024.03 | 0.9836 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP4Attack Budget=0.52024.03 | 0.9832 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP5Attack Budget=0.452024.03 | 0.9832 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP5Attack Budget=0.52024.03 | 0.9832 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SICOAttack Budget=0.32024.03 | 0.9824 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP3Attack Budget=0.352024.03 | 0.982 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCTSAttack Budget=0.052024.03 | 0.982 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RBAttack Budget=0.32024.03 | 0.9736 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCTSAttack Budget=0.12024.03 | 0.9736 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RBAttack Budget=0.352024.03 | 0.97 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RBAttack Budget=0.42024.03 | 0.9668 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RBAttack Budget=0.452024.03 | 0.9616 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RBAttack Budget=0.52024.03 | 0.9584 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCTSAttack Budget=0.152024.03 | 0.9552 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SICOAttack Budget=0.52024.03 | 0.9488 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCTSAttack Budget=0.22024.03 | 0.9132 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP1Attack Budget=1 (Unconstrained)2024.03 | 0.8852 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP2Attack Budget=1 (Unconstrained)2024.03 | 0.8708 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP3Attack Budget=1 (Unconstrained)2024.03 | 0.87 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP4Attack Budget=1 (Unconstrained)2024.03 | 0.8564 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCTSAttack Budget=0.252024.03 | 0.8488 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SICOAttack Budget=1 (Unconstrained)2024.03 | 0.816 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RP5Attack Budget=1 (Unconstrained)2024.03 | 0.8088 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCTSAttack Budget=0.32024.03 | 0.7324 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCTSAttack Budget=0.352024.03 | 0.5932 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCTSAttack Budget=0.42024.03 | 0.4428 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCTSAttack Budget=0.452024.03 | 0.3288 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCTSAttack Budget=0.52024.03 | 0.2604 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RBc=1, Hashing=left2024.03 | — | 0.9984 | 0.9892 | 0.9816 | 0.9732 | 0.96 | 0.9524 | 0.932 | 0.9024 | 0.8744 | 0.8134 | 0.7488 | — | |
| RBc=2, Hashing=left2024.03 | — | 0.9888 | 0.9792 | 0.9536 | 0.9404 | 0.9196 | 0.8968 | 0.8712 | 0.8168 | 0.7728 | 0.7048 | 0.6628 | — | |
| RBc=4, Hashing=left2024.03 | — | 0.9884 | 0.9888 | 0.9812 | 0.9688 | 0.9492 | 0.9166 | 0.88 | 0.833 | 0.758 | 0.6668 | 0.6668 | — | |
| RBc=8, Hashing=left2024.03 | — | 0.9816 | 0.9736 | 0.9548 | 0.926 | 0.888 | 0.8508 | 0.7968 | 0.7188 | 0.6332 | 0.577 | 0.577 | — | |
| RBc=1, Hashing=self2024.03 | — | 0.9988 | 0.996 | 0.9964 | 0.9952 | 0.9896 | 0.9888 | 0.9832 | 0.974 | 0.968 | 0.958 | 0.9536 | — | |
| RBc=2, Hashing=self2024.03 | — | 0.9912 | 0.9764 | 0.9724 | 0.9656 | 0.9564 | 0.9368 | 0.9288 | 0.9108 | 0.868 | 0.8268 | 0.76 | — |