RouterBench
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
RouterBench Quality-Priority
0.792Reward
16
RouterBench Cost-Sensitive
0.834Reward
16
RouterBench
91.91AUC
14
RouterBench
1.66QNC
14
RouterBench
55.58Utility Score
12
RouterBench (test)
91.4Accuracy
11
RouterBench
31.05Ranking Quality Gain (%)
9
RouterBench Out-of-domain
75.6nAUC
9
RouterBench Quality-Priority
0.612Reward
8
RouterBench Cost-Sensitive
0.623Reward
8
RouterBench subsampled 2500 s
79.1Accuracy
8
RouterBench held-out (test)
91.3Accuracy
6
RouterBench
—Accuracy
0