LLM Routing on Average across Benchmarks (val)
83Avg Top-1 AccORACLE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ORACLEModel Pool=Pool Large, Router Category=Oracle2026.01 | 83 | — | |
| ORACLEModel Pool=Pool Small, Router Category=Oracle2026.01 | 75 | — | |
| CASCAL-GTModel Pool=Pool Large, Router Category=Query-answer Routers2026.01 | 65.7 | 64.5 | |
| LLMRANKModel Pool=Pool Large, Router Category=Query-answer Routers2026.01 | 65.6 | — | |
| TOP-1 / TOP-3Model Pool=Pool Large, Router Category=Baseline2026.01 | 65.1 | 64.6 | |
| AVENGERSModel Pool=Pool Large, Router Category=Query-answer Routers2026.01 | 63.4 | — | |
| CASCALModel Pool=Pool Large, Router Category=Query-only Routers2026.01 | 62.2 | 63.6 | |
| SMOOTHIEModel Pool=Pool Large, Router Category=Query-only Routers2026.01 | 57.1 | 59.3 | |
| AVENGERSModel Pool=Pool Small, Router Category=Query-answer Routers2026.01 | 50.2 | — | |
| TOP-1 / TOP-3Model Pool=Pool Small, Router Category=Baseline2026.01 | 49.9 | 49.2 | |
| CASCAL-GTModel Pool=Pool Small, Router Category=Query-answer Routers2026.01 | 49.7 | 47.3 | |
| LLMRANKModel Pool=Pool Small, Router Category=Query-answer Routers2026.01 | 48.8 | — | |
| CASCALModel Pool=Pool Small, Router Category=Query-only Routers2026.01 | 46.6 | 46.4 | |
| SMOOTHIEModel Pool=Pool Small, Router Category=Query-only Routers2026.01 | 43.4 | 45.9 |