LLM Routing on In-domain datasets Balance, alpha=0.5
93AccuracyOracle
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Oracletype=Topline2025.10 | 93 | 0.29 | 0.79 | |
| Largest LLMtype=Naive Baselines2025.10 | 85 | 0.9 | 0.4 | |
| DiSRouterMode=SFT2025.10 | 83 | 0.52 | 0.57 | |
| GraphRoutertype=Router Baselines2025.10 | 77 | 0.46 | 0.53 | |
| DiSRouterMode=SFT + RL2025.10 | 77 | 0.32 | 0.61 | |
| FORCtype=Router Baselines2025.10 | 69 | 0.45 | 0.47 | |
| Randomtype=Naive Baselines2025.10 | 67 | 0.46 | 0.44 | |
| FrugalGPTtype=Router Baselines2025.10 | 63 | 0.22 | 0.52 | |
| Automixtype=Router Baselines2025.10 | 58 | 0.58 | 0.29 | |
| RouteLLMtype=Router Baselines2025.10 | 44 | 0.16 | 0.36 | |
| Smallest LLMtype=Naive Baselines2025.10 | 38 | 0.1 | 0.33 |