Text Classification on AGNews (Performance, Cost, and Passrates)
94Performance ScoreLLM w/o cascade
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| LLM w/o cascadeCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE2026.05 | 94 | 112.58 | 8.12 | 100 | 100 | — | |
| LLM w/o cascadeCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B2026.05 | 94 | 112.58 | 8.12 | — | — | 100 | |
| InitialCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B2026.05 | 91.5 | 63.57 | 4.79 | — | — | 48 | |
| InitialCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE2026.05 | 89.5 | 52.31 | 4.13 | 55 | 29 | — | |
| Single-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=SLM only2026.05 | 79 | 92.18 | 6.91 | 71 | 52 | — | |
| Random noiseCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B2026.05 | 78.5 | 99.78 | 7.07 | — | — | 80.5 | |
| Joint-target attackCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B, Setting=P=12026.05 | 75.5 | 104.37 | 7.41 | — | — | 83.5 | |
| Single-target attackCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B, Setting=SLM only2026.05 | 74 | 96.41 | 6.87 | — | — | 74 | |
| Random noiseCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE2026.05 | 72.5 | 64.14 | 5.07 | 57.5 | 17.5 | — | |
| Single-target attackCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B, Setting=DM only2026.05 | 69.5 | 78.6 | 6.01 | — | — | 54 | |
| Joint-target attackCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B, Setting=P=0.82026.05 | 69.5 | 93.07 | 6.59 | — | — | 69.5 | |
| Joint-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=P=12026.05 | 66.5 | 77.5 | 5.79 | 81 | 36 | — | |
| Single-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=DM only2026.05 | 64.5 | 67.85 | 5.58 | 50 | 26 | — | |
| Joint-target attackCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B, Setting=P=0.62026.05 | 61 | 82.29 | 5.74 | — | — | 59.5 | |
| Joint-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=P=0.82026.05 | 59.5 | 64.58 | 5.16 | 70.5 | 30 | — | |
| Joint-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=P=0.62026.05 | 50 | 50.41 | 4.41 | 62.5 | 25.5 | — | |
| Joint-target attackCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B, Setting=P=0.42026.05 | 49.5 | 60.17 | 4.42 | — | — | 44.5 | |
| Joint-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=P=0.42026.05 | 42 | 39.77 | 3.96 | 50.5 | 22.5 | — | |
| Joint-target attackCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B, Setting=P=0.22026.05 | 40.5 | 39.84 | 3.61 | — | — | 34.5 | |
| Joint-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=P=0.22026.05 | 35.5 | 28.97 | 3.18 | 39.5 | 17.5 | — | |
| Joint-target attackCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B, Setting=P=02026.05 | 25.5 | 21.44 | 2.58 | — | — | 21 | |
| Joint-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=P=02026.05 | 21.5 | 19.4 | 2.27 | 24 | 8 | — |