Attacking Cascade System Decision Maker on SQuAD 2.0
86.5PerformanceLLM w/o cascade
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| LLM w/o cascadeCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE2026.05 | 86.5 | 277.24 | 8.49 | 100 | 100 | |
| InitialCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE2026.05 | 81 | 110.31 | 4.97 | 51.5 | 24 | |
| Joint-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=P=12026.05 | 70.5 | 242.17 | 8.27 | 61.5 | 50.5 | |
| Random noiseCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE2026.05 | 69 | 141.89 | 7.04 | 52 | 24.5 | |
| Single-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=SLM only2026.05 | 68 | 206.4 | 7.64 | 60.5 | 42 | |
| Joint-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=P=0.82026.05 | 63 | 216.3 | 7.62 | 59.5 | 41.5 | |
| Single-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=DM only2026.05 | 60 | 174.98 | 6.41 | 54 | 38.5 | |
| Joint-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=P=0.62026.05 | 52.5 | 191.74 | 6.72 | 55 | 32 | |
| Joint-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=P=0.42026.05 | 43.5 | 158.54 | 5.89 | 54 | 24 | |
| Joint-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=P=0.22026.05 | 36 | 131.33 | 5.05 | 52 | 15 | |
| Joint-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=P=02026.05 | 28.5 | 90.89 | 4.37 | 54.5 | 8.5 |