Routing on RouterBench (test)
91.4AccuracyOracle
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Oracle2026.01 | 91.4 | 0.39 | — | 88.2 | |
| PROTEUSEncoder=DeBERTa-v3-small, Encoder parameters=22M, Batch size=82026.01 | 90.1 | 0.33 | 11.1 | 88.5 | |
| Best Fixed (GPT-4)2026.01 | 77.9 | 3.3 | — | 0 | |
| KNNEncoder parameters=22–125M, Batch size=82026.01 | 77.2 | 2.3 | 7.4 | 25.5 | |
| MLPEncoder parameters=22–125M, Batch size=82026.01 | 76.7 | 2.3 | 7.3 | 25.4 | |
| CARROT-QualityEncoder parameters=22–125M, Batch size=82026.01 | 74.9 | 1.34 | 6.9 | 41.4 | |
| CARROT-BalancedEncoder parameters=22–125M, Batch size=82026.01 | 67.9 | 0.21 | 6 | 69.5 | |
| OmniRouterEncoder parameters=22–125M, Batch size=82026.01 | 66.2 | 0.24 | 5.3 | 67.1 | |
| CARROT-CostEncoder parameters=22–125M, Batch size=82026.01 | 52.9 | 0.09 | 0.2 | 55.7 | |
| Random2026.01 | 52.4 | 0.86 | — | 42.4 | |
| Cheapest2026.01 | 30.4 | 0.05 | — | 32.7 |