Multi-Objective Routing in LLM Serving on LMSYS-Chat-1M 1.0 (test)
0.67Average EELLOR
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| LORprediction_mode=noisy decode-length prediction, prediction_noise=Unif(0.8oj, 1.2oj)2026.07 | 0.67 | 4.01 | 6.19 | 0.53 | 0.98 | |
| Power-of-2prediction_mode=noisy decode-length prediction, prediction_noise=Unif(0.8oj, 1.2oj)2026.07 | 1.3 | 3.84 | 6.06 | 0.73 | 1.84 | |
| AHD Bid Price Control Routerprediction_mode=noisy decode-length prediction, prediction_noise=Unif(0.8oj, 1.2oj)2026.07 | 45.75 | 42.49 | 25.85 | 0.9 | 11.1 |