Utility Prediction Routing on MMMU
92.3OpenAI ScoreOracle
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Oracle2025.05 | 92.3 | 80.28 | |
| Attnk=1002025.05 | 79.26 | 61.29 | |
| kNNk=1002025.05 | 78.11 | 61.27 | |
| Graphk=1002025.05 | 77.73 | 61.67 | |
| Linear2025.05 | 75.05 | 60.54 | |
| kNNk=102025.05 | 75.04 | 58.26 | |
| Graphk=102025.05 | 75.04 | 62.04 | |
| MLPMF=true2025.05 | 74.66 | 61.67 | |
| Attnk=102025.05 | 73.87 | 58.26 | |
| D-Attnk=102025.05 | 73.8 | 58.28 | |
| D-Attnk=1002025.05 | 73.41 | 61.28 | |
| LinearMF=true2025.05 | 71.61 | 60.16 | |
| MLP2025.05 | 68.12 | 57.95 | |
| Random2025.05 | 64.47 | 47.76 |