Adversarial Robustness Evaluation on ASAG
1.3ASRPAIR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| PAIRGrader=Claude-Sonnet-4.62026.06 | 1.3 | -0.025 | 0.135 | |
| DANGrader=Claude-Sonnet-4.62026.06 | 8.2 | 0.019 | 0.267 | |
| PAIRGrader=GPT-5-mini2026.06 | 28.8 | 0.03 | 0.096 | |
| MSJGrader=Gemini-3-flash2026.06 | 50 | 0.058 | 0.001 | |
| PAIRGrader=Qwen3-4B2026.06 | 50 | 0.171 | 0 | |
| MSJGrader=Claude-Sonnet-4.62026.06 | 53.1 | 0.158 | 0 | |
| PAIRGrader=Gemini-3-flash2026.06 | 55.6 | 0.111 | 0 | |
| MSJGrader=GPT-5-mini2026.06 | 57.1 | 0.064 | 0.002 | |
| MSJGrader=Qwen3-4B2026.06 | 59.4 | 0.184 | 0 | |
| PAIRGrader=Llama-3.1-8B2026.06 | 60.8 | 0.238 | 0 | |
| DANGrader=GPT-5-mini2026.06 | 68.3 | 0.122 | 0 | |
| DANGrader=Gemini-3-flash2026.06 | 84.1 | 0.196 | 0 | |
| DANGrader=Qwen3-4B2026.06 | 91.9 | 0.341 | 0 | |
| DANGrader=Llama-3.1-8B2026.06 | 100 | 0.498 | 0 | |
| MSJGrader=Llama-3.1-8B2026.06 | 100 | 0.452 | 0 |