Model Routing on Model-Query Evaluation (test)
64.7Routing Accuracy (%)LOCUS
Evaluation results
| Method | Links | |
|---|---|---|
| LOCUSNumber of evaluation queries=10242026.01 | 64.7 | |
| IRT-NETNumber of evaluation queries=10242026.01 | 63.37 | |
| LOCUSNumber of evaluation queries=5122026.01 | 62.97 | |
| LOCUSNumber of evaluation queries=2562026.01 | 61.9 | |
| IRT-NETNumber of evaluation queries=5122026.01 | 60.17 | |
| EMBEDLLMNumber of evaluation queries=10242026.01 | 59.6 | |
| IRT-NETNumber of evaluation queries=2562026.01 | 59.57 | |
| EMBEDLLMNumber of evaluation queries=5122026.01 | 59.47 | |
| EMBEDLLMNumber of evaluation queries=2562026.01 | 58.8 |