Watermark Removal on Watermarked Text 1500 tokens
73EWDRLCracker
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| RLCrackerModel=Qwen2.5-3B-Instruct2025.09 | 73 | 71.5 | 66.5 | 98.5 | 58 | 78 | 77.8 | |
| RLCrackerModel=Qwen3-8B2025.09 | 70 | 71.3 | 69.3 | 81.8 | 64.5 | 84.3 | 73.3 | |
| RLCrackerModel=Qwen3-4B2025.09 | 64 | 65.3 | 66.3 | 63.8 | 57.3 | 82.3 | 64.3 | |
| RLCrackerModel=Qwen3-0.6B2025.09 | 63.3 | 61.5 | 60 | 87.5 | 48.5 | 66.8 | 62 | |
| RLCrackerModel=Qwen3-1.7B2025.09 | 62.7 | 61.3 | 62.3 | 77.8 | 60.5 | 68 | 61 | |
| Think+SysPModel=Qwen3-8B2025.09 | 56.2 | 59.8 | 64.5 | 7.2 | 58 | 78.2 | 63.2 | |
| ThinkModel=Qwen3-8B2025.09 | 54 | 51.5 | 57.8 | 7.25 | 55.8 | 71.3 | 59.5 | |
| ThinkModel=Qwen3-1.7B2025.09 | 42.5 | 48 | 53.5 | 4.5 | 47 | 66.3 | 55.5 | |
| Think+SysPModel=Qwen3-1.7B2025.09 | 41.5 | 45.5 | 59 | 6.2 | 52.5 | 68.5 | 60.2 | |
| ThinkModel=Qwen3-4B2025.09 | 40.8 | 45 | 62 | 4.75 | 52.3 | 78 | 59 | |
| Think+SysPModel=Qwen3-4B2025.09 | 38.2 | 46.2 | 63.2 | 6.5 | 54.2 | 79.5 | 63.5 | |
| BaseModel=Qwen3-8B2025.09 | 33.5 | 30 | 48.8 | 5.25 | 46.8 | 58.8 | 44.3 | |
| SysPModel=Qwen3-8B2025.09 | 32 | 38.8 | 52.5 | 6.75 | 51 | 64.5 | 50.3 | |
| SysPModel=Qwen2.5-3B-Instruct2025.09 | 27.3 | 35.5 | 45.3 | 5.5 | 44.8 | 56.8 | 42.8 | |
| Think+SysPModel=Qwen3-0.6B2025.09 | 14.8 | 16.2 | 38.2 | 5.2 | 19.8 | 47.8 | 30 | |
| SysPModel=Qwen3-4B2025.09 | 12.5 | 15 | 45 | 5.5 | 19.3 | 40.8 | 34.5 | |
| BaseModel=Qwen2.5-3B-Instruct2025.09 | 11.5 | 17 | 39.3 | 3.5 | 20.5 | 50.8 | 16 | |
| ThinkModel=Qwen3-0.6B2025.09 | 10.8 | 10.3 | 32 | 6 | 15.8 | 33 | 22.5 | |
| GPT-4o2025.09 | 10.3 | 20.5 | 50.3 | 6.75 | 49.3 | 61.8 | 49.3 | |
| BaseModel=Qwen3-4B2025.09 | 10 | 12.3 | 38 | 4.5 | 15.8 | 36 | 25.8 | |
| SysPModel=Qwen3-1.7B2025.09 | 7.5 | 10.5 | 39.5 | 5.8 | 16 | 41 | 30 | |
| SysPModel=Qwen3-0.6B2025.09 | 5.75 | 12.5 | 39.3 | 6.25 | 15 | 37 | 22 | |
| BaseModel=Qwen3-1.7B2025.09 | 4.25 | 6.75 | 30.3 | 5 | 9.25 | 32.5 | 19.3 | |
| BaseModel=Qwen3-0.6B2025.09 | 3.5 | 4.25 | 26 | 5 | 6 | 17.5 | 11.8 | |
| DIPPER2025.09 | 1.15 | 5.75 | 0 | 4.5 | 11.5 | 41.5 | 21 | |
| SIRAModel=Qwen3-0.6B2025.09 | 0 | 0 | 0 | 0.25 | 0 | 0 | 0 | |
| SIRAModel=Qwen3-1.7B2025.09 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| SIRAModel=Qwen3-4B2025.09 | 0 | 0.75 | 0 | 1.25 | 0 | 0 | 0 | |
| SIRAModel=Qwen3-8B2025.09 | 0 | 0.25 | 0 | 0.5 | 0 | 0 | 0.25 | |
| SIRAModel=Qwen2.5-3B-Instruct2025.09 | 0 | 0 | 0 | 0 | 0.5 | 0.5 | 0 |