# LLM Routing on In-domain

Source: [LLM Routing on In-domain](<https://www.sota2.com/research/sota/llm-routing-on-in-domain>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-13T09:42:56.321Z

Evaluation of LLM routing performance on the 'In-domain' dataset, measured using composite metrics balancing Cost, Performance, and Utility across different optimization priorities.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | LLM Routing |
| Dataset (including any stated split) | In-domain |
| Metric | Cost (Cost-first) |
| Unit | PERCENT |
| Direction | Lower is better |
| Results loaded | 7 of 7 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Cost (Cost-first)](<https://www.sota2.com/research/sota/llm-routing-on-in-domain.md?metric=Cost%20(Cost-first)>): Lower is better; unit: PERCENT.

- [Performance (Cost-first)](<https://www.sota2.com/research/sota/llm-routing-on-in-domain.md?metric=Performance%20(Cost-first)>): Higher is better; unit: PERCENT.

- [Utility (Cost-first)](<https://www.sota2.com/research/sota/llm-routing-on-in-domain.md?metric=Utility%20(Cost-first)>): Higher is better; unit: PERCENT.

- [Cost (Balance)](<https://www.sota2.com/research/sota/llm-routing-on-in-domain.md?metric=Cost%20(Balance)>): Lower is better; unit: PERCENT.

- [Performance (Balance)](<https://www.sota2.com/research/sota/llm-routing-on-in-domain.md?metric=Performance%20(Balance)>): Higher is better; unit: PERCENT.

- [Utility (Balance)](<https://www.sota2.com/research/sota/llm-routing-on-in-domain.md?metric=Utility%20(Balance)>): Higher is better; unit: PERCENT.

- [Cost (Performance-first)](<https://www.sota2.com/research/sota/llm-routing-on-in-domain.md?metric=Cost%20(Performance-first)>): Lower is better; unit: PERCENT.

- [Performance (Performance-first)](<https://www.sota2.com/research/sota/llm-routing-on-in-domain.md?metric=Performance%20(Performance-first)>): Higher is better; unit: PERCENT.

- [Utility (Performance-first)](<https://www.sota2.com/research/sota/llm-routing-on-in-domain.md?metric=Utility%20(Performance-first)>): Higher is better; unit: PERCENT.

- [Utility Sum](<https://www.sota2.com/research/sota/llm-routing-on-in-domain.md?metric=Utility%20Sum>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Cost (Cost-first) | Result date | Report paper |
| --- | --- | --- | --- |
| FrugalGPT | 2.3 | Not recorded | 69dc789f7d0172140ec78bc2 |
| GraphRouter | 2.4 | Not recorded | 69dc789f7d0172140ec78bc2 |
| RouterDC | 3.69 | Not recorded | 69dc789f7d0172140ec78bc2 |
| MetricRouter | 3.76 | Not recorded | 69dc789f7d0172140ec78bc2 |
| Oracle | 3.88 | Not recorded | 69dc789f7d0172140ec78bc2 |
| TRouter | 4.21 | Not recorded | 69dc789f7d0172140ec78bc2 |
| C2MAB-V | 6.36 | Not recorded | 69dc789f7d0172140ec78bc2 |

### FrugalGPT

Cost (Cost-first): 2.3. Result ID: 69dcba8947f34ce924c40fb2.

[Reporting paper](<https://www.sota2.com/research/paper/69dc789f7d0172140ec78bc2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f421e209131cea44942.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"LLM-as-a-judge"}. This record does not assert independent reproduction.

### GraphRouter

Cost (Cost-first): 2.4. Result ID: 69dcba8947f34ce924c40fb1.

[Reporting paper](<https://www.sota2.com/research/paper/69dc789f7d0172140ec78bc2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa777b1e209131cea737d1.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"LLM-as-a-judge"}. This record does not assert independent reproduction.

### RouterDC

Cost (Cost-first): 3.69. Result ID: 69dcba8947f34ce924c40fb0.

[Reporting paper](<https://www.sota2.com/research/paper/69dc789f7d0172140ec78bc2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75041e209131cea65450.md>)

[Implementation](<https://github.com/shuhao02/RouterDC>)

Recorded evaluation configuration: {"Evaluation Protocol":"LLM-as-a-judge"}. This record does not assert independent reproduction.

### MetricRouter

Cost (Cost-first): 3.76. Result ID: 69dcba8947f34ce924c40fb4.

[Reporting paper](<https://www.sota2.com/research/paper/69dc789f7d0172140ec78bc2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79091e209131cea7bd42.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"LLM-as-a-judge"}. This record does not assert independent reproduction.

### Oracle

Cost (Cost-first): 3.88. Result ID: 69dcba8947f34ce924c40fb6.

[Reporting paper](<https://www.sota2.com/research/paper/69dc789f7d0172140ec78bc2.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"LLM-as-a-judge"}. This record does not assert independent reproduction.

### TRouter

Cost (Cost-first): 4.21. Result ID: 69dcba8947f34ce924c40fb5.

[Reporting paper](<https://www.sota2.com/research/paper/69dc789f7d0172140ec78bc2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69dc789f7d0172140ec78bc2.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"LLM-as-a-judge"}. This record does not assert independent reproduction.

### C2MAB-V

Cost (Cost-first): 6.36. Result ID: 69dcba8947f34ce924c40fb3.

[Reporting paper](<https://www.sota2.com/research/paper/69dc789f7d0172140ec78bc2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75091e209131cea6573f.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"LLM-as-a-judge"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
