LLM Routing on OOD
89AccuracyOracle
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| OracleScenario=Cost First, α=0.82025.10 | 89 | 0.33 | 63 | |
| Largest LLMScenario=Cost First, α=0.82025.10 | 74 | 0.9 | 2 | |
| DiSRouterScenario=Cost First, α=0.8, Stage=SFT2025.10 | 69 | 0.56 | 25 | |
| DiSRouterScenario=Cost First, α=0.8, Stage=+ RL2025.10 | 67 | 0.36 | 39 | |
| RandomScenario=Cost First, α=0.82025.10 | 59 | 0.46 | 22 | |
| FrugalGPTScenario=Cost First, α=0.82025.10 | 55 | 0.21 | 38 | |
| FORCScenario=Cost First, α=0.82025.10 | 54 | 0.32 | 29 | |
| GraphRouterScenario=Cost First, α=0.82025.10 | 53 | 0.2 | 37 | |
| RouteLLMScenario=Cost First, α=0.82025.10 | 42 | 0.22 | 25 | |
| AutomixScenario=Cost First, α=0.82025.10 | 40 | 0.29 | 17 | |
| Smallest LLMScenario=Cost First, α=0.82025.10 | 36 | 0.1 | 28 |