Policy Perturbation Detection on General Data Protection Regulation (GDPR)
1Detection RateDEEPSEEK-R1
Evaluation results
| Method | Links | |
|---|---|---|
| DEEPSEEK-R1Perturbation=Deontic Norm, DEF Stage=DEF 32026.01 | 1 | |
| DEEPSEEK-R1Perturbation=Deontic Norm, DEF Stage=DEF 12026.01 | 0.983 | |
| DEEPSEEK-R1Perturbation=Deontic Norm, DEF Stage=DEF 22026.01 | 0.983 | |
| GPT-5-MINIPerturbation=Deontic Norm, DEF Stage=DEF 32026.01 | 0.983 | |
| DEEPSEEK-R1Perturbation=Authorization, DEF Stage=DEF 32026.01 | 0.979 | |
| DEEPSEEK-R1Perturbation=Deontic Norm, DEF Stage=No DEF2026.01 | 0.89 | |
| DEEPSEEK-R1Perturbation=Authorization, DEF Stage=DEF 12026.01 | 0.83 | |
| DEEPSEEK-R1Perturbation=Authorization, DEF Stage=DEF 22026.01 | 0.718 | |
| GPT-5-MINIPerturbation=Deontic Norm, DEF Stage=DEF 22026.01 | 0.585 | |
| QWEN3-30B-THINKPerturbation=Deontic Norm, DEF Stage=DEF 32026.01 | 0.5 | |
| GPT-5-MINIPerturbation=Deontic Norm, DEF Stage=DEF 12026.01 | 0.491 | |
| QWEN3-30B-THINKPerturbation=Deontic Norm, DEF Stage=DEF 12026.01 | 0.339 | |
| QWEN3-30B-THINKPerturbation=Deontic Norm, DEF Stage=DEF 22026.01 | 0.339 | |
| DEEPSEEK-R1Perturbation=Authorization, DEF Stage=No DEF2026.01 | 0.297 | |
| QWEN3-30B-THINKPerturbation=Deontic Norm, DEF Stage=No DEF2026.01 | 0.254 | |
| GPT-5-MINIPerturbation=Authorization, DEF Stage=DEF 32026.01 | 0.239 | |
| GPT-5-MINIPerturbation=Deontic Norm, DEF Stage=No DEF2026.01 | 0.212 | |
| QWEN3-30B-THINKPerturbation=Authorization, DEF Stage=DEF 32026.01 | 0.058 | |
| QWEN3-30B-THINKPerturbation=Authorization, DEF Stage=DEF 12026.01 | 0.053 | |
| QWEN3-30B-THINKPerturbation=Authorization, DEF Stage=DEF 22026.01 | 0.048 | |
| QWEN3-30B-THINKPerturbation=Deontic Norm, DEF Stage=Correct2026.01 | 0.032 | |
| QWEN3-30B-THINKPerturbation=Authorization, DEF Stage=Correct2026.01 | 0.032 | |
| QWEN3-30B-THINKPerturbation=Authorization, DEF Stage=No DEF2026.01 | 0.032 | |
| GPT-5-MINIPerturbation=Authorization, DEF Stage=DEF 12026.01 | 0.021 | |
| DEEPSEEK-R1Perturbation=Deontic Norm, DEF Stage=Correct2026.01 | 0.016 | |
| DEEPSEEK-R1Perturbation=Authorization, DEF Stage=Correct2026.01 | 0.016 | |
| GPT-5-MINIPerturbation=Authorization, DEF Stage=No DEF2026.01 | 0.011 | |
| GPT-5-MINIPerturbation=Deontic Norm, DEF Stage=Correct2026.01 | 0 | |
| GPT-5-MINIPerturbation=Authorization, DEF Stage=Correct2026.01 | 0 | |
| GPT-5-MINIPerturbation=Authorization, DEF Stage=DEF 22026.01 | 0 |