LLM Routing on RouterArena (Evaluation set)
80.72Arena S ScoreOracle
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Oracle# arms used=102026.05 | 80.72 | 39.4 | |
| Full-info batch fit (tuned)# arms used=102026.05 | 74.05 | 31.8 | |
| Full-info batch fit (default λ)# arms used=102026.05 | 73.54 | 26 | |
| OrcaRouter (Submission)# arms used=102026.05 | 72.08 | 19.7 | |
| RR+UCB# arms used=102026.05 | 70.74 | 18.2 | |
| ϵ-greedy LinUCB# arms used=102026.05 | 70.71 | 20 | |
| Always-DSC# arms used=12026.05 | 70.31 | 100 | |
| LinTS (v=0.3)# arms used=≈22026.05 | 70 | 72.8 | |
| Vanilla LinUCB (α=1)# arms used=102026.05 | 69.81 | 15.5 |