LLM Routing on MMLU-PRO
91.5Top-1 AccORACLE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ORACLEModel Pool=Pool Large, Training Data Source=Gemini-2.5-Flash2026.01 | 91.5 | — | |
| ORACLEModel Pool=Pool Small, Training Data Source=Gemini-2.5-Flash2026.01 | 84.4 | — | |
| TOP-1 / TOP-3Model Pool=Pool Large, Training Data Source=Gemini-2.5-Flash2026.01 | 79.4 | 80.9 | |
| CASCAL-GTModel Pool=Pool Large, Router Category=Query-answer Routers, Training Data Source=Gemini-2.5-Flash2026.01 | 78.8 | 79.6 | |
| AVENGERSModel Pool=Pool Large, Router Category=Query-answer Routers, Training Data Source=Gemini-2.5-Flash2026.01 | 78.6 | — | |
| LLMRANKModel Pool=Pool Large, Router Category=Query-answer Routers, Training Data Source=Gemini-2.5-Flash2026.01 | 76.7 | — | |
| CASCALModel Pool=Pool Large, Router Category=Query-only Routers, Training Data Source=Gemini-2.5-Flash2026.01 | 76.7 | 80.3 | |
| SMOOTHIEModel Pool=Pool Large, Router Category=Query-only Routers, Training Data Source=Gemini-2.5-Flash2026.01 | 75.1 | 78.6 | |
| TOP-1 / TOP-3Model Pool=Pool Small, Training Data Source=Gemini-2.5-Flash2026.01 | 66.2 | 65.7 | |
| CASCAL-GTModel Pool=Pool Small, Router Category=Query-answer Routers, Training Data Source=Gemini-2.5-Flash2026.01 | 65.6 | 61.6 | |
| LLMRANKModel Pool=Pool Small, Router Category=Query-answer Routers, Training Data Source=Gemini-2.5-Flash2026.01 | 65 | — | |
| AVENGERSModel Pool=Pool Small, Router Category=Query-answer Routers, Training Data Source=Gemini-2.5-Flash2026.01 | 64.9 | — | |
| CASCALModel Pool=Pool Small, Router Category=Query-only Routers, Training Data Source=Gemini-2.5-Flash2026.01 | 64.8 | 62.2 | |
| SMOOTHIEModel Pool=Pool Small, Router Category=Query-only Routers, Training Data Source=Gemini-2.5-Flash2026.01 | 60.6 | 62.2 |