Watermark Detection on C4 (250 tokens)
96.7TPR @ FPR 0.1%ENS-MCMark
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ENS-MCMarkBackbone=Llama-3.2-3B-Instruct, lambda=0.82026.02 | 96.7 | 93.7 | 88.5 | 0 | |
| ENS-MCMarkBackbone=Llama-3.2-3B-Instruct, lambda=12026.02 | 95.1 | 91.8 | 87.3 | 0 | |
| SynthIDBackbone=Llama-3.2-3B-Instruct, lambda=0.82026.02 | 94.5 | 90.5 | 86.1 | 0 | |
| SynthIDBackbone=Llama-3.2-3B-Instruct, lambda=12026.02 | 93.8 | 88.4 | 83.5 | 0 | |
| SynthIDBackbone=Mistral-7B-Instruct-v0.3, lambda=0.82026.02 | 93.6 | 87.4 | 78 | 0 | |
| ENS-MCMarkBackbone=Mistral-7B-Instruct-v0.3, lambda=0.82026.02 | 93.6 | 88.8 | 82.1 | 0 | |
| ENS-MCMarkBackbone=Mistral-7B-Instruct-v0.3, lambda=12026.02 | 93.3 | 87.5 | 80.5 | 0 | |
| SynthIDBackbone=Mistral-7B-Instruct-v0.3, lambda=12026.02 | 91.9 | 83.2 | 75 | 0 | |
| ENS-DiPmarkBackbone=Llama-3.2-3B-Instruct, alpha=0.42026.02 | 74.7 | 67.2 | 58.5 | 0 | |
| ENS-DiPmarkBackbone=Llama-3.2-3B-Instruct, alpha=0.52026.02 | 74 | 64.1 | 54.9 | 0 | |
| ENS-DiPmarkBackbone=Mistral-7B-Instruct-v0.3, alpha=0.42026.02 | 48.3 | 33.6 | 20.7 | 0.0014 | |
| ENS-DiPmarkBackbone=Mistral-7B-Instruct-v0.3, alpha=0.52026.02 | 46.8 | 27.8 | 19.1 | 0.0021 |