Large Language Model Routing and Orchestration on 6 Domain-Specific Tasks Aggregate
100Quality ScoreAlways-T4
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Always-T4System=Always-T42026.04 | 100 | 100 | 1,847 | 38.2 | |
| Hybrid LLMSystem=Hybrid LLM2026.04 | 97.2 | 31.2 | 874 | 18.7 | |
| ROUTENLPSystem=ROUTENLP, Cascade usage=true, Co-optimization usage=true, Task conditioning usage=true2026.04 | 97.1 | 15.9 | 387 | 2.3 | |
| RouteLLMSystem=RouteLLM2026.04 | 96.9 | 24.6 | 841 | 17.2 | |
| FrugalGPTSystem=FrugalGPT2026.04 | 96.7 | 28.4 | 986 | 21.3 | |
| ROUTENLP w/o task cond.System=ROUTENLP, Cascade usage=true, Co-optimization usage=true, Task conditioning usage=false2026.04 | 96.4 | 18.7 | 395 | 2.7 | |
| ROUTENLP w/o co-opt.System=ROUTENLP, Cascade usage=true, Co-optimization usage=false, Task conditioning usage=true2026.04 | 96.1 | 20.3 | 412 | 3.1 | |
| AutoMixSystem=AutoMix2026.04 | 95.8 | 23.1 | 1,124 | 24.6 | |
| ROUTENLP w/o cascadeSystem=ROUTENLP, Cascade usage=false, Co-optimization usage=true, Task conditioning usage=true2026.04 | 95.2 | 13.4 | 298 | 1.8 | |
| Rule-BasedSystem=Rule-Based2026.04 | 94.3 | 19.8 | 524 | 8.9 | |
| RandomSystem=Random2026.04 | 92.4 | 25.2 | 623 | 12.4 | |
| Always-T2System=Always-T22026.04 | 89.1 | 1.3 | 142 | 0.1 |