Watermark Removal on Watermarked Text 500 tokens
94.8EWDRLCracker
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| RLCrackerModel=Qwen3-8B2025.09 | 94.8 | 96.3 | 90.2 | 80.5 | 91.5 | 90.8 | 84.3 | |
| RLCrackerModel=Qwen3-4B2025.09 | 93.3 | 95.8 | 85.5 | 73.5 | 89 | 88.8 | 82.3 | |
| RLCrackerModel=Qwen2.5-3B-Instruct2025.09 | 93.3 | 95.3 | 89.8 | 78.5 | 97.5 | 89.8 | 81.8 | |
| RLCrackerModel=Qwen3-1.7B2025.09 | 91.8 | 91 | 86 | 73 | 76.8 | 87.5 | 79.5 | |
| RLCrackerModel=Qwen3-0.6B2025.09 | 91.5 | 92.5 | 86.5 | 67 | 80.8 | 85.3 | 76.8 | |
| Think+SysPModel=Qwen3-8B2025.09 | 90.2 | 92 | 86.8 | 41 | 57.5 | 86.2 | 74 | |
| ThinkModel=Qwen3-8B2025.09 | 89 | 91 | 81.5 | 40.8 | 53.8 | 83.8 | 71.8 | |
| Think+SysPModel=Qwen3-1.7B2025.09 | 84 | 86.5 | 79.8 | 34.8 | 28.2 | 86 | 77.5 | |
| ThinkModel=Qwen3-1.7B2025.09 | 80.8 | 88 | 75.5 | 31 | 28.3 | 86 | 71.3 | |
| Think+SysPModel=Qwen3-4B2025.09 | 78.8 | 88 | 79.2 | 38.8 | 47.5 | 88.2 | 81.2 | |
| ThinkModel=Qwen3-4B2025.09 | 76 | 83.5 | 75.3 | 39.5 | 51.7 | 85.3 | 71.8 | |
| SysPModel=Qwen2.5-3B-Instruct2025.09 | 75.5 | 83 | 78.5 | 43.5 | 31.8 | 84.5 | 74 | |
| SysPModel=Qwen3-8B2025.09 | 72.8 | 81.5 | 82 | 43.5 | 72 | 85.5 | 73 | |
| BaseModel=Qwen3-8B2025.09 | 72 | 70.8 | 77 | 40.5 | 74.5 | 81.3 | 68.3 | |
| GPT-4o2025.09 | 71 | 81.5 | 77.3 | 49.8 | 53.8 | 86.8 | 78 | |
| SysPModel=Qwen3-1.7B2025.09 | 59.8 | 70.8 | 70.8 | 40.5 | 51.3 | 76.3 | 63.3 | |
| SysPModel=Qwen3-4B2025.09 | 54.3 | 65.8 | 66.8 | 43.8 | 68.8 | 79.3 | 63 | |
| Think+SysPModel=Qwen3-0.6B2025.09 | 48.2 | 58.8 | 50.7 | 37.5 | 34.5 | 69.2 | 53.8 | |
| BaseModel=Qwen3-4B2025.09 | 39.3 | 53.3 | 50.3 | 39.3 | 72 | 70 | 47.8 | |
| SysPModel=Qwen3-0.6B2025.09 | 36.5 | 44.8 | 52.5 | 42.5 | 52.3 | 63.3 | 37.3 | |
| BaseModel=Qwen3-1.7B2025.09 | 34.3 | 42.8 | 43 | 34 | 62.3 | 56.8 | 36.5 | |
| BaseModel=Qwen2.5-3B-Instruct2025.09 | 31.3 | 46.8 | 68.8 | 37.3 | 46 | 58.8 | 37 | |
| DIPPER2025.09 | 30.3 | 52.8 | 0 | 33.3 | 29 | 72 | 43.5 | |
| ThinkModel=Qwen3-0.6B2025.09 | 28.5 | 35.3 | 37.3 | 34.3 | 45.3 | 66.3 | 27.3 | |
| BaseModel=Qwen3-0.6B2025.09 | 13.5 | 21.3 | 29 | 35.8 | 60 | 35.5 | 14.5 | |
| SIRAModel=Qwen3-1.7B2025.09 | 0.25 | 0 | 0.25 | 0 | 5.8 | 0.25 | 0 | |
| SIRAModel=Qwen2.5-3B-Instruct2025.09 | 0.25 | 0.25 | 0.25 | 0.75 | 2.25 | 0.75 | 0 | |
| SIRAModel=Qwen3-0.6B2025.09 | 0 | 0 | 0 | 0 | 24.8 | 0.25 | 0 | |
| SIRAModel=Qwen3-4B2025.09 | 0 | 0 | 0.25 | 0.75 | 12.3 | 0.25 | 0 | |
| SIRAModel=Qwen3-8B2025.09 | 0 | 0 | 0.25 | 0.5 | 22.3 | 0.25 | 0 |