Query Routing on RAG Evaluation Workload
197.3Mean Billed Tokensfixed_light
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| fixed_lightPolicy=fixed_light2026.03 | 197.3 | 2,091 | 82 | 0.167 | |
| router_cost_sensitivePolicy=cost_sensitive2026.03 | 231.8 | 2,536 | 81 | 0.117 | |
| fixed_mediumPolicy=fixed_medium2026.03 | 239.5 | 1,906 | 82 | 0.177 | |
| fixed_directPolicy=fixed_direct2026.03 | 249.9 | 4,457 | 80 | -0.367 | |
| router_defaultPolicy=default2026.03 | 252.4 | 2,927 | 80 | 0.192 | |
| router_latency_sensitivePolicy=latency_sensitive2026.03 | 256 | 2,165 | 81 | -0.291 | |
| fixed_heavyPolicy=fixed_heavy2026.03 | 343.2 | 1,932 | 81 | 0.132 |