LLM Routing on In-domain datasets Cost First, alpha=0.8
93AccuracyOracle
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Oracletype=Topline2025.10 | 93 | 0.29 | 0.7 | |
| Largest LLMtype=Naive Baselines2025.10 | 85 | 0.9 | 0.13 | |
| DiSRouterMode=SFT2025.10 | 77 | 0.42 | 0.43 | |
| DiSRouterMode=SFT + RL2025.10 | 75 | 0.29 | 0.52 | |
| Randomtype=Naive Baselines2025.10 | 67 | 0.46 | 0.3 | |
| GraphRoutertype=Router Baselines2025.10 | 61 | 0.2 | 0.45 | |
| FrugalGPTtype=Router Baselines2025.10 | 60 | 0.21 | 0.43 | |
| FORCtype=Router Baselines2025.10 | 60 | 0.29 | 0.37 | |
| RouteLLMtype=Router Baselines2025.10 | 44 | 0.16 | 0.31 | |
| Automixtype=Router Baselines2025.10 | 44 | 0.33 | 0.18 | |
| Smallest LLMtype=Naive Baselines2025.10 | 38 | 0.1 | 0.3 |