LLM Routing on MEDMCQA (val)
96.3Top-1 AccORACLE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ORACLEModel Pool=Pool Large, Router Category=Oracle2026.01 | 96.3 | — | |
| TOP-1 / TOP-3Model Pool=Pool Large, Router Category=Baseline2026.01 | 92.7 | 88.5 | |
| CASCAL-GTModel Pool=Pool Large, Router Category=Query-answer Routers2026.01 | 92.7 | 87 | |
| AVENGERSModel Pool=Pool Large, Router Category=Query-answer Routers2026.01 | 92.7 | — | |
| LLMRANKModel Pool=Pool Large, Router Category=Query-answer Routers2026.01 | 92.7 | — | |
| ORACLEModel Pool=Pool Small, Router Category=Oracle2026.01 | 91.2 | — | |
| CASCALModel Pool=Pool Large, Router Category=Query-only Routers2026.01 | 85.7 | 86.5 | |
| SMOOTHIEModel Pool=Pool Large, Router Category=Query-only Routers2026.01 | 78 | 80.8 | |
| TOP-1 / TOP-3Model Pool=Pool Small, Router Category=Baseline2026.01 | 71 | 70.2 | |
| CASCAL-GTModel Pool=Pool Small, Router Category=Query-answer Routers2026.01 | 71 | 68.7 | |
| LLMRANKModel Pool=Pool Small, Router Category=Query-answer Routers2026.01 | 71 | — | |
| AVENGERSModel Pool=Pool Small, Router Category=Query-answer Routers2026.01 | 70.6 | — | |
| SMOOTHIEModel Pool=Pool Small, Router Category=Query-only Routers2026.01 | 67.9 | 69.1 | |
| CASCALModel Pool=Pool Small, Router Category=Query-only Routers2026.01 | 65.5 | 68.4 |