Paraphrase Attack Robustness on C4 RealNewsLike
0.9871AUCKGW
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| KGWBase LLM=OPT-1.3B2025.12 | 0.9871 | 0.915 | 0.96 | 0.7506 | |
| EWDBase LLM=OPT-1.3B2025.12 | 0.9759 | 0.895 | 0.935 | 0.7769 | |
| SWEETBase LLM=OPT-1.3B2025.12 | 0.9731 | 0.855 | 0.935 | 0.773 | |
| DualGuardBase LLM=OPT-1.3B2025.12 | 0.968 | 0.86 | 0.925 | 0.9482 | |
| EWDBase LLM=Llama3.1-8B-Instruct2025.12 | 0.941 | 0.78 | 0.86 | 0.722 | |
| SIRBase LLM=Llama3.1-8B-Instruct2025.12 | 0.9274 | 0.69 | 0.785 | 0.687 | |
| DualGuardBase LLM=Llama3.1-8B-Instruct2025.12 | 0.9244 | 0.62 | 0.76 | 0.9201 | |
| SIRBase LLM=OPT-1.3B2025.12 | 0.9235 | 0.605 | 0.81 | 0.6713 | |
| XSIRBase LLM=OPT-1.3B2025.12 | 0.9224 | 0.625 | 0.74 | 0.6762 | |
| SWEETBase LLM=Llama3.1-8B-Instruct2025.12 | 0.9185 | 0.625 | 0.745 | 0.7374 | |
| KGWBase LLM=Llama3.1-8B-Instruct2025.12 | 0.8734 | 0.505 | 0.66 | 0.7153 | |
| XSIRBase LLM=Llama3.1-8B-Instruct2025.12 | 0.7968 | 0.45 | 0.525 | 0.6518 | |
| AARBase LLM=OPT-1.3B2025.12 | 0.7513 | 0.07 | 0.185 | 0.5649 | |
| AARBase LLM=Llama3.1-8B-Instruct2025.12 | 0.7117 | 0.14 | 0.245 | 0.5724 | |
| SynthIDBase LLM=OPT-1.3B2025.12 | 0.7108 | 0.205 | 0.29 | 0.6447 | |
| SynthIDBase LLM=Llama3.1-8B-Instruct2025.12 | 0.6139 | 0.05 | 0.11 | 0.5912 | |
| DIPmarkBase LLM=Llama3.1-8B-Instruct2025.12 | 0.5337 | 0.125 | 0.19 | 0.523 | |
| DIPmarkBase LLM=OPT-1.3B2025.12 | 0.5161 | 0.115 | 0.165 | 0.5365 | |
| UnbiasedBase LLM=OPT-1.3B2025.12 | 0.5011 | 0.0496 | 0.0993 | 0.4983 | |
| UnbiasedBase LLM=Llama3.1-8B-Instruct2025.12 | 0.5003 | 0.0516 | 0.1033 | 0.5012 |