Text Classification on SST-2 (test) using ACC and ASR
95.75AccuracyBadTemplate
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BadTemplateBackbone=Gemini-2.5, Attack Level=Sentence-level2026.02 | 95.75 | 100 | |
| BadTemplateBackbone=GPT-4o-mini, Attack Level=Sentence-level2026.02 | 95.75 | 100 | |
| Gemini-2.5Protocol=ICL-1Shot, Attack Level=Sentence-level2026.02 | 95.5 | 53.12 | |
| Gemini-2.5Protocol=ICL-2Shot, Attack Level=Sentence-level2026.02 | 95.37 | 53.62 | |
| Deepseek-v3.2Protocol=Clean, Attack Level=Sentence-level2026.02 | 95.25 | 50 | |
| Deepseek-v3.2Protocol=ICL-1Shot, Attack Level=Sentence-level2026.02 | 94.87 | 55.25 | |
| Deepseek-v3.2Protocol=ICL-3Shot, Attack Level=Sentence-level2026.02 | 94.87 | 55.87 | |
| Gemini-2.5Protocol=Clean, Attack Level=Sentence-level2026.02 | 94.75 | 50 | |
| GPT-4o-miniProtocol=ICL-1Shot, Attack Level=Sentence-level2026.02 | 94.62 | 53.75 | |
| GPT-4o-miniProtocol=ICL-2Shot, Attack Level=Sentence-level2026.02 | 94.62 | 53.62 | |
| Deepseek-v3.2Protocol=ICL-2Shot, Attack Level=Sentence-level2026.02 | 94.5 | 55.62 | |
| GPT-4o-miniProtocol=ICL-3Shot, Attack Level=Sentence-level2026.02 | 94 | 54.37 | |
| GPT-4o-miniProtocol=Clean, Attack Level=Sentence-level2026.02 | 92.37 | 50 | |
| Gemini-2.5Protocol=ICL-3Shot, Attack Level=Sentence-level2026.02 | 91.75 | 58.25 | |
| BadTemplateBackbone=Deepseek-v3.2, Attack Level=Sentence-level2026.02 | 89.87 | 100 |