Adversarial Evasion Attack on MGT Academic STEM
100ASRMASH
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MASHDetector=fine-tuned RoBERTa, Threshold (τ)=0.52026.01 | 100 | 20.08 | 0.6431 | 0.8194 | |
| DIPPERDetector=fine-tuned RoBERTa, Threshold (τ)=0.52026.01 | 55 | 12.47 | 0.6039 | 0.8789 | |
| GradEscapeDetector=fine-tuned RoBERTa, Threshold (τ)=0.52026.01 | 38 | 20.4 | 0.6162 | 0.9499 | |
| CharmerDetector=fine-tuned RoBERTa, Threshold (τ)=0.52026.01 | 29 | 11.62 | 0.5437 | 0.9874 | |
| CoPADetector=fine-tuned RoBERTa, Threshold (τ)=0.52026.01 | 16 | 23.75 | 0.6446 | 0.8698 | |
| DPO-EvaderDetector=fine-tuned RoBERTa, Threshold (τ)=0.52026.01 | 14 | 8.37 | 0.5404 | 0.9329 | |
| DeepWordBugDetector=fine-tuned RoBERTa, Threshold (τ)=0.52026.01 | 7 | 22.64 | 0.4662 | 0.9543 | |
| TextFoolerDetector=fine-tuned RoBERTa, Threshold (τ)=0.52026.01 | 7 | 81.24 | 0.3189 | 0.9255 | |
| TextBuggerDetector=fine-tuned RoBERTa, Threshold (τ)=0.52026.01 | 6 | 39.93 | 0.4041 | 0.9333 | |
| HMGCDetector=fine-tuned RoBERTa, Threshold (τ)=0.52026.01 | 3 | 42.69 | 0.5283 | 0.9257 | |
| PromptAttackDetector=fine-tuned RoBERTa, Threshold (τ)=0.52026.01 | 1 | 10.39 | 0.6529 | 0.934 | |
| MASHDetector=Binoculars2026.01 | 0.99 | 14.02 | 0.6434 | 0.8864 | |
| GradEscapeDetector=Binoculars2026.01 | 0.95 | 20.92 | 0.6546 | 0.9286 | |
| PromptAttackDetector=Binoculars2026.01 | 0.81 | 9.33 | 0.6904 | 0.9318 | |
| HMGCDetector=Binoculars2026.01 | 0.73 | 15.25 | 0.5384 | 0.9708 | |
| CharmerDetector=Binoculars2026.01 | 0.71 | 10.16 | 0.5592 | 0.9841 | |
| DIPPERDetector=Binoculars2026.01 | 0.49 | 10.86 | 0.6429 | 0.9048 | |
| CoPADetector=Binoculars2026.01 | 0.23 | 7.85 | 0.3377 | 0.9328 | |
| DPO-EvaderDetector=Binoculars2026.01 | 0.04 | 5.02 | 0.1795 | 0.9525 | |
| DeepWordBugDetector=Binoculars2026.01 | 0 | 8.43 | 0.5746 | 0.9871 | |
| TextBuggerDetector=Binoculars2026.01 | 0 | 10.42 | 0.5485 | 0.968 | |
| TextFoolerDetector=Binoculars2026.01 | 0 | 9.92 | 0.5776 | 0.984 |