Predictive LLM Routing on OpenLLM
64.11LLaMA3 ScoreOracle
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Oracle2025.05 | 64.11 | 83.32 | 64.12 | |
| Graphk=1002025.05 | 49.1 | 55.24 | 39.52 | |
| D-Attnk=1002025.05 | 49.04 | 23.9 | 34.92 | |
| kNNk=1002025.05 | 48.98 | 56.18 | 39.74 | |
| Linear2025.05 | 48.94 | 56.46 | 41.83 | |
| LinearRepresentation=Matrix Factorization (MF)2025.05 | 48.94 | 55.91 | 41.88 | |
| MLPRepresentation=Matrix Factorization (MF)2025.05 | 48.71 | 56.21 | 41.63 | |
| MLP2025.05 | 48.52 | 54.62 | 41.19 | |
| Attnk=1002025.05 | 45.12 | 56.03 | 32.65 | |
| kNNk=102025.05 | 41.45 | 39.67 | 34.98 | |
| Attnk=102025.05 | 41.09 | 48 | 34.58 | |
| Graphk=102025.05 | 40.06 | 54.99 | 33.62 | |
| D-Attnk=102025.05 | 39.54 | 32.05 | 34.81 | |
| D-Attnk=102025.05 | 39.31 | 25.41 | 37.24 | |
| MLP2025.05 | 39.11 | 26.2 | 33.3 | |
| Attnk=102025.05 | 38.86 | 24.85 | 33.76 | |
| MLPMatrix Factorization=true2025.05 | 38.58 | 24.62 | 32.24 | |
| LinearMatrix Factorization=true2025.05 | 38.57 | 24.82 | 32.15 | |
| Attnk=1002025.05 | 38.51 | 23.42 | 33.93 | |
| Graphk=102025.05 | 38.49 | 24.72 | 32.12 | |
| Linear2025.05 | 38.43 | 24.38 | 32.11 | |
| D-Attnk=1002025.05 | 37.95 | 23.94 | 34.44 | |
| Random2025.05 | 37.86 | 41.98 | 33.94 | |
| kNNk=102025.05 | 37.85 | 25.61 | 32.82 | |
| kNNk=1002025.05 | 37.56 | 22.61 | 32.09 | |
| Graphk=1002025.05 | 37.41 | 21.69 | 32.09 |