LLM Routing on MMR-Bench
0.918nAUCOracle
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| OracleRouting Objective=Oriented2026.05 | 0.918 | — | — | — | |
| OracleRouting Objective=Cost2026.05 | 0.899 | — | — | — | |
| LATENTROUTERRouting Objective=Oriented2026.05 | 0.792 | — | — | — | |
| LATENTROUTERRouting Objective=Cost2026.05 | 0.786 | — | — | — | |
| RouteLLMRouting Objective=Oriented2026.05 | 0.759 | — | — | — | |
| KMeansRouterRouting Objective=Cost2026.05 | 0.759 | — | — | — | |
| StrongestRouting Objective=Oriented2026.05 | 0.758 | — | — | — | |
| KMeansRouterRouting Objective=Oriented2026.05 | 0.758 | — | — | — | |
| StrongestRouting Objective=Cost2026.05 | 0.758 | — | — | — | |
| ECVLRouting Objective=Oriented2026.05 | 0.748 | — | — | — | |
| ECVLRouting Objective=Cost2026.05 | 0.748 | — | — | — | |
| MLPMFRouterRouting Objective=Oriented2026.05 | 0.739 | — | — | — | |
| MLPMFRouterRouting Objective=Cost2026.05 | 0.738 | — | — | — | |
| R2-RouterRouting Objective=Oriented2026.05 | 0.736 | — | — | — | |
| GraphRouterRouting Objective=Oriented2026.05 | 0.734 | — | — | — | |
| KNNRouterRouting Objective=Oriented2026.05 | 0.726 | — | — | — | |
| R2-RouterRouting Objective=Cost2026.05 | 0.725 | — | — | — | |
| KNNRouterRouting Objective=Cost2026.05 | 0.724 | — | — | — | |
| GraphRouterRouting Objective=Cost2026.05 | 0.714 | — | — | — | |
| EquiRouterConfiguration=Full2026.02 | 0.7059 | 0.8784 | 0.743 | 0.6949 | |
| EquiRouterConfiguration=w/o ranking loss2026.02 | 0.7044 | 0.9752 | 0.7437 | 0.7135 | |
| EquiRouterConfiguration=w/o joint feature2026.02 | 0.7041 | 0.9395 | 0.7415 | 0.7025 | |
| AvengersProVenue=DAI ’252026.02 | 0.7007 | — | 0.7362 | 0.728 | |
| NIRT2026.02 | 0.6974 | 0.9815 | 0.7454 | 0.784 | |
| kNNRouterVenue=EMNLP ’242026.02 | 0.6959 | 0.9895 | 0.7416 | 0.7895 | |
| CausalRouterVenue=NeurIPS ’252026.02 | 0.6914 | 1.0517 | 0.7442 | 0.714 | |
| MIRTVenue=ACL ’252026.02 | 0.6904 | 0.9995 | 0.7417 | 0.7828 | |
| EmbedLLMVenue=ICLR ’242026.02 | 0.6863 | — | 0.7369 | 0.7546 | |
| MLPRouter2026.02 | 0.6815 | 1 | 0.7384 | 0.7819 | |
| RouteLLMRouting Objective=Cost2026.05 | 0.634 | — | — | — | |
| GraphRouterVenue=ICLR ’252026.02 | 0.6214 | 1 | 0.7384 | 0.7819 | |
| RouterDCRouting Objective=Cost2026.05 | 0.619 | — | — | — | |
| RandomRouting Objective=Oriented2026.05 | 0.608 | — | — | — | |
| RandomRouting Objective=Cost2026.05 | 0.606 | — | — | — | |
| RouterDCRouting Objective=Oriented2026.05 | 0.582 | — | — | — | |
| CheapestRouting Objective=Oriented2026.05 | 0.438 | — | — | — | |
| CheapestRouting Objective=Cost2026.05 | 0.438 | — | — | — |