LLM Routing on In-domain datasets Performance First, alpha=0.2
93AccuracyOracle
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Oracletype=Topline2025.10 | 93 | 0.29 | 87 | |
| Largest LLMtype=Naive Baselines2025.10 | 85 | 0.9 | 67 | |
| Automixtype=Router Baselines2025.10 | 85 | 1.1 | 63 | |
| DiSRouterMode=SFT2025.10 | 84 | 0.59 | 72 | |
| GraphRoutertype=Router Baselines2025.10 | 82 | 0.68 | 68 | |
| DiSRouterMode=SFT + RL2025.10 | 81 | 0.4 | 73 | |
| FORCtype=Router Baselines2025.10 | 78 | 0.65 | 65 | |
| FrugalGPTtype=Router Baselines2025.10 | 70 | 0.32 | 64 | |
| Randomtype=Naive Baselines2025.10 | 67 | 0.46 | 58 | |
| RouteLLMtype=Router Baselines2025.10 | 44 | 0.16 | 41 | |
| Smallest LLMtype=Naive Baselines2025.10 | 38 | 0.1 | 36 |