List your company
ResearchFormerly WizWand

Text Classification on AGNews (Performance, Cost, and Passrates)

94Performance ScoreLLM w/o cascade
18.638.17557.7577.325May 17, 2026
Updated 5mo ago

Evaluation results

MethodLinks
LLM w/o cascadeCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE2026.0594112.588.12100100—
LLM w/o cascadeCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B2026.0594112.588.12——100
InitialCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B2026.0591.563.574.79——48
InitialCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE2026.0589.552.314.135529—
Single-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=SLM only2026.057992.186.917152—
Random noiseCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B2026.0578.599.787.07——80.5
Joint-target attackCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B, Setting=P=12026.0575.5104.377.41——83.5
Single-target attackCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B, Setting=SLM only2026.057496.416.87——74
Random noiseCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE2026.0572.564.145.0757.517.5—
Single-target attackCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B, Setting=DM only2026.0569.578.66.01——54
Joint-target attackCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B, Setting=P=0.82026.0569.593.076.59——69.5
Joint-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=P=12026.0566.577.55.798136—
Single-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=DM only2026.0564.567.855.585026—
Joint-target attackCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B, Setting=P=0.62026.056182.295.74——59.5
Joint-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=P=0.82026.0559.564.585.1670.530—
Joint-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=P=0.62026.055050.414.4162.525.5—
Joint-target attackCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B, Setting=P=0.42026.0549.560.174.42——44.5
Joint-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=P=0.42026.054239.773.9650.522.5—
Joint-target attackCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B, Setting=P=0.22026.0540.539.843.61——34.5
Joint-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=P=0.22026.0535.528.973.1839.517.5—
Joint-target attackCascade System=Qwen2.5-3B + DistilBERT-base + Phi-3.5-MoE 16x3.8B, Setting=P=02026.0525.521.442.58——21
Joint-target attackCascade system=Qwen2.5 + BERT-base + Mistral-7B + BERT-base + Phi-3.5-MoE, Setting=P=02026.0521.519.42.27248—