LLM Routing on MMLU-PRO (val)
91.5Top-1 AccORACLE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ORACLEModel Pool=Pool Large, Router Category=Oracle2026.01 | 91.5 | — | |
| ORACLEModel Pool=Pool Small, Router Category=Oracle2026.01 | 84.4 | — | |
| TOP-1 / TOP-3Model Pool=Pool Large, Router Category=Baseline2026.01 | 79.4 | 80.9 | |
| CASCALModel Pool=Pool Large, Router Category=Query-only Routers2026.01 | 78.9 | 81 | |
| LLMRANKModel Pool=Pool Large, Router Category=Query-answer Routers2026.01 | 78.5 | — | |
| CASCAL-GTModel Pool=Pool Large, Router Category=Query-answer Routers2026.01 | 78 | 80.6 | |
| AVENGERSModel Pool=Pool Large, Router Category=Query-answer Routers2026.01 | 78 | — | |
| SMOOTHIEModel Pool=Pool Large, Router Category=Query-only Routers2026.01 | 74.8 | 77.6 | |
| TOP-1 / TOP-3Model Pool=Pool Small, Router Category=Baseline2026.01 | 66.2 | 65.7 | |
| CASCAL-GTModel Pool=Pool Small, Router Category=Query-answer Routers2026.01 | 66 | 63 | |
| AVENGERSModel Pool=Pool Small, Router Category=Query-answer Routers2026.01 | 65.9 | — | |
| LLMRANKModel Pool=Pool Small, Router Category=Query-answer Routers2026.01 | 65 | — | |
| CASCALModel Pool=Pool Small, Router Category=Query-only Routers2026.01 | 62.9 | 62.8 | |
| SMOOTHIEModel Pool=Pool Small, Router Category=Query-only Routers2026.01 | 55.8 | 60.9 |