# LLM Routing In-domain (test)

Source: [LLM Routing In-domain (test)](<https://www.sota2.com/research/sota/llm-routing-in-domain-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-13T09:42:56.346Z

Evaluation of LLM routing performance on the test split of the 'LLM Routing In-domain' dataset, measured using composite metrics balancing Cost, Performance, and Utility across different optimization priorities.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | LLM Routing |
| Dataset (including any stated split) | LLM Routing In-domain (test) |
| Metric | Cost (Cost-first) |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Cost (Cost-first)](<https://www.sota2.com/research/sota/llm-routing-in-domain-test.md?metric=Cost%20(Cost-first)>): Lower is better; unit: SCALAR.

- [Performance (Cost-first)](<https://www.sota2.com/research/sota/llm-routing-in-domain-test.md?metric=Performance%20(Cost-first)>): Higher is better; unit: SCALAR.

- [Utility (Cost-first)](<https://www.sota2.com/research/sota/llm-routing-in-domain-test.md?metric=Utility%20(Cost-first)>): Higher is better; unit: SCALAR.

- [Cost (Balance)](<https://www.sota2.com/research/sota/llm-routing-in-domain-test.md?metric=Cost%20(Balance)>): Lower is better; unit: SCALAR.

- [Performance (Balance)](<https://www.sota2.com/research/sota/llm-routing-in-domain-test.md?metric=Performance%20(Balance)>): Higher is better; unit: SCALAR.

- [Utility (Balance)](<https://www.sota2.com/research/sota/llm-routing-in-domain-test.md?metric=Utility%20(Balance)>): Higher is better; unit: SCALAR.

- [Cost (Performance-first)](<https://www.sota2.com/research/sota/llm-routing-in-domain-test.md?metric=Cost%20(Performance-first)>): Lower is better; unit: SCALAR.

- [Performance (Performance-first)](<https://www.sota2.com/research/sota/llm-routing-in-domain-test.md?metric=Performance%20(Performance-first)>): Higher is better; unit: SCALAR.

- [Utility (Performance-first)](<https://www.sota2.com/research/sota/llm-routing-in-domain-test.md?metric=Utility%20(Performance-first)>): Higher is better; unit: SCALAR.

- [Utility Sum](<https://www.sota2.com/research/sota/llm-routing-in-domain-test.md?metric=Utility%20Sum>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Cost (Cost-first) | Result date | Report paper |
| --- | --- | --- | --- |
| FrugalGPT | 0.023 | Not recorded | 69dc789f7d0172140ec78bc2 |
| Oracle | 0.0354 | Not recorded | 69dc789f7d0172140ec78bc2 |
| TRouter | 0.0393 | Not recorded | 69dc789f7d0172140ec78bc2 |
| TRouter | 0.04 | Not recorded | 69dc789f7d0172140ec78bc2 |
| MetricRouter | 0.0479 | Not recorded | 69dc789f7d0172140ec78bc2 |
| GraphRouter | 0.048 | Not recorded | 69dc789f7d0172140ec78bc2 |
| RouterDC | 0.0578 | Not recorded | 69dc789f7d0172140ec78bc2 |
| C2MAB-V | 0.064 | Not recorded | 69dc789f7d0172140ec78bc2 |

### FrugalGPT

Cost (Cost-first): 0.023. Result ID: 69dcba8947f34ce924c40fc1.

[Reporting paper](<https://www.sota2.com/research/paper/69dc789f7d0172140ec78bc2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f421e209131cea44942.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Oracle

Cost (Cost-first): 0.0354. Result ID: 69dcba8947f34ce924c40fc6.

[Reporting paper](<https://www.sota2.com/research/paper/69dc789f7d0172140ec78bc2.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### TRouter

Cost (Cost-first): 0.0393. Result ID: 69dcba8947f34ce924c40fc4.

[Reporting paper](<https://www.sota2.com/research/paper/69dc789f7d0172140ec78bc2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69dc789f7d0172140ec78bc2.md>)

Recorded evaluation configuration: {"Synthesis framework":"gpt-4.1"}. This record does not assert independent reproduction.

### TRouter

Cost (Cost-first): 0.04. Result ID: 69dcba8947f34ce924c40fc5.

[Reporting paper](<https://www.sota2.com/research/paper/69dc789f7d0172140ec78bc2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69dc789f7d0172140ec78bc2.md>)

Recorded evaluation configuration: {"Synthesis framework":"gemini-2.5-flash"}. This record does not assert independent reproduction.

### MetricRouter

Cost (Cost-first): 0.0479. Result ID: 69dcba8947f34ce924c40fc3.

[Reporting paper](<https://www.sota2.com/research/paper/69dc789f7d0172140ec78bc2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79091e209131cea7bd42.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GraphRouter

Cost (Cost-first): 0.048. Result ID: 69dcba8947f34ce924c40fc0.

[Reporting paper](<https://www.sota2.com/research/paper/69dc789f7d0172140ec78bc2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa777b1e209131cea737d1.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RouterDC

Cost (Cost-first): 0.0578. Result ID: 69dcba8947f34ce924c40fbf.

[Reporting paper](<https://www.sota2.com/research/paper/69dc789f7d0172140ec78bc2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75041e209131cea65450.md>)

[Implementation](<https://github.com/shuhao02/RouterDC>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### C2MAB-V

Cost (Cost-first): 0.064. Result ID: 69dcba8947f34ce924c40fc2.

[Reporting paper](<https://www.sota2.com/research/paper/69dc789f7d0172140ec78bc2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75091e209131cea6573f.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
