Task Efficient Routing on Security scenario
0.0021CostForce Weak
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Force Weak2026.01 | 0.0021 | 67.2 | |
| CASTER2026.01 | 0.0049 | 23.4 | |
| Force Strong2026.01 | 0.0064 | — | |
| Force WeakModel=qwen2026.01 | 0.01 | 63.5 | |
| Force WeakModel=openai2026.01 | 0.0207 | 95.8 | |
| CASTERModel=qwen2026.01 | 0.0257 | 6.2 | |
| Force StrongModel=qwen2026.01 | 0.0274 | — | |
| Force StrongModel=deepseek2026.01 | 0.0983 | — | |
| CASTERModel=deepseek2026.01 | 0.1105 | -12.4 | |
| Force WeakModel=deepseek2026.01 | 0.1118 | -13.7 | |
| Force WeakModel=gemini2026.01 | 0.1408 | 85.7 | |
| CASTERModel=openai2026.01 | 0.2234 | 54.3 | |
| CASTERStrategy=Dynamic Routing2026.01 | 0.23 | 20.7 | |
| FrugalGPT (Cascade)Strategy=Cascade2026.01 | 0.29 | — | |
| CASTERModel=gemini2026.01 | 0.3064 | 68.9 | |
| Force WeakModel=claude2026.01 | 0.3346 | 84.8 | |
| Force StrongModel=openai2026.01 | 0.4886 | — | |
| CASTERModel=claude2026.01 | 0.9129 | 58.4 | |
| Force StrongModel=gemini2026.01 | 0.9837 | — | |
| Force StrongModel=claude2026.01 | 2.1948 | — |