Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

LLM Routing research benchmarks – Page 2 · SOTA2 Research

LLM Routing

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

MMR-Bench Out-of-domain

0.67nAUC

9

Feb 26, 2026

RouterBench Out-of-domain

75.6nAUC

9

Feb 26, 2026

LLM Routing In-domain (test)

0.023Cost (Cost-first)

8

Apr 13, 2026

GPT series models Out of Domain

82Accuracy

8

Mar 4, 2026

GPT series models (In Domain)

97Accuracy

8

Mar 4, 2026

SWE-bench Lite N=300 (test)

Priority-aware (oracle; upper bound)

179.75Loss

7

Jun 4, 2026

2.3Cost (Cost-first)

7

Apr 13, 2026

MMLU Pro Others (Out-of-Domain)

0.624LPM

7

Feb 26, 2026

MMLU Pro Social Sciences (Out-of-Domain)

59.2LPM

7

Feb 26, 2026

MMLU Pro Humanities Out-of-Domain

51.74LPM

7

Feb 26, 2026

MMLU Pro STEM (Out-of-Domain)

59.2LPM

7

Feb 26, 2026

MATH Out-of-Domain

69.24LPM Score

7

Feb 26, 2026

Magpie Out-of-Domain

63.53LPM Score

7

Feb 26, 2026

78.51LPM

7

Feb 26, 2026

MMLU Pro Out-of-Domain

65.32STEM Score

7

Feb 26, 2026

MATH Out-of-Domain

73.9AUROC

7

Feb 26, 2026

Magpie Out-of-Domain

74.08AUROC

7

Feb 26, 2026

0.679AUROC

7

Feb 26, 2026

Big Math In-Domain

0.662AUROC

7

Feb 26, 2026

Alpaca In-Domain

0.72AUROC

7

Feb 26, 2026

FullStackBench (OOD)

0.867HV

6

Jun 5, 2026

75.48HV

6

Jun 5, 2026

0.841HV Score

6

Jun 5, 2026

Magicoder (in-distribution)

0.851HV Score

6

Jun 5, 2026

MATH (in-distribution)

86.97HV Score

6

Jun 5, 2026

Page 2 of 3

Popular datasets

MMLU MATH RouterBench In-domain datasets MedMCQA

Follow for updates

Join SOTA2 Contact