Adversarial Attack Transferability on API-based Language Model Cascade Evaluation Set
94Cascade AccuracyCascade Pipeline
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Cascade PipelineSetting Index=(30), Cost Method=USD (API)2026.05 | 94 | 0.49 | 82.5 | 0.27 | 87.5 | 0.3 | 94.5 | 1.37 | 96.5 | 98 | |
| Cascade PipelineSetting Index=(33), Cost Method=USD (API)2026.05 | 93.5 | 0.31 | 80 | 0.092 | 89 | 0.19 | 95 | 0.46 | 94 | 95.5 | |
| Cascade PipelineSetting Index=(31), Cost Method=USD (API)2026.05 | 93 | 0.49 | 82.5 | 0.27 | 87.5 | 0.3 | 94.5 | 1.37 | 95 | 94 | |
| Cascade PipelineSetting Index=(32), Cost Method=USD (API)2026.05 | 92 | 0.24 | 80 | 0.092 | 89 | 0.19 | 95 | 0.46 | 92 | 89.5 | |
| Cascade PipelineSetting Index=(8), Cost Method=Average Tokens2026.05 | 89 | 41.2 | 71 | 3.4 | — | — | 91 | 104.1 | 91.5 | — | |
| Cascade PipelineSetting Index=(1), Cost Method=Average Tokens2026.05 | 78 | 10.37 | 48 | 0.51 | — | — | 76 | 25.19 | 86.5 | — | |
| Joint-target AttackSetting Index=(30), Transfer Source=(1), Cost Method=USD (API)2026.05 | 77.5 | 0.42 | 75 | 0.29 | 79.5 | 0.32 | 87 | 1.42 | 71 | 76 | |
| Joint-target AttackSetting Index=(30), Transfer Source=(8), Cost Method=USD (API)2026.05 | 76 | 0.44 | 71 | 0.28 | 78 | 0.31 | 89 | 1.41 | 68 | 81 | |
| Joint-target AttackSetting Index=(32), Transfer Source=(1), Cost Method=USD (API)2026.05 | 72.5 | 0.18 | 72 | 0.097 | 77.5 | 0.2 | 90 | 0.5 | 75.5 | 80 | |
| Joint-target AttackSetting Index=(31), Transfer Source=(8), Cost Method=USD (API)2026.05 | 72 | 0.4 | 71 | 0.28 | 78 | 0.31 | 89 | 1.41 | 62 | 85.5 | |
| Joint-target AttackSetting Index=(31), Transfer Source=(1), Cost Method=USD (API)2026.05 | 72 | 0.4 | 71 | 0.28 | 78 | 0.31 | 89 | 1.41 | 62 | 85.5 | |
| Joint-target AttackSetting Index=(33), Transfer Source=(1), Cost Method=USD (API)2026.05 | 70.5 | 0.17 | 72 | 0.097 | 77.5 | 0.2 | 90 | 0.5 | 71 | 74 | |
| Joint-target AttackSetting Index=(8), Transfer Source=(8), Cost Method=Average Tokens2026.05 | 52.5 | 18.4 | 50 | 3.4 | — | — | 84 | 104.5 | 19 | — | |
| Joint-target AttackSetting Index=(1), Transfer Source=(1), Cost Method=Average Tokens2026.05 | 21 | 9.3 | 16 | 0.63 | — | — | 63 | 25.47 | 18 | — |