Watermark Evasion on vicuna-7b 50 samples, UMD watermarking v1.5-16k (test) benchmark leaderboard · SOTA2 Research

Watermark Evasion on vicuna-7b 50 samples, UMD watermarking v1.5-16k (test)

58ASR (0 Unattacked)SCTS

Evaluation Results

Method	Links
SCTS2024.03		58	80	92	96	100	100	100	100	100	100	100	—
SCTS2024.03		24	38	68	—	98	100	100	100	100	100	100	—
RP12024.03		18	18	18	18	18	18	18	18	18	20	28	96
RP22024.03		18	18	18	18	18	22	20	24	26	30	36	94
RP32024.03		18	18	18	18	18	24	26	28	32	36	46	100
RP42024.03		18	18	18	18	18	24	30	26	40	40	58	96
RP52024.03		18	18	18	20	18	24	30	28	44	42	62	100
SICO2024.03		18	28	28	28	30	30	32	30	28	40	40	82
RB2024.03		18	44	60	72	82	90	92	94	100	100	100	—
SCTS2024.03		18	56	74	92	96	100	100	100	100	100	100	100
SCTS2024.03		16	42	72	92	100	100	100	100	100	100	100	100
SCTS2024.03		16	54	80	92	100	100	100	100	100	100	100	100
SCTS2024.03		12	44	60	72	88	96	100	100	100	100	100	—
SCTS2024.03		10	36	66	88	96	98	98	98	98	98	98	—
SCTS2024.03		8	46	68	92	100	100	100	100	100	100	100	100