Utility Prediction Routing on MathVista
89.3OpenAI ScoreOracle
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Oracle2025.05 | 89.3 | 63.66 | |
| kNNk=1002025.05 | 72.96 | 50.29 | |
| Attnk=1002025.05 | 71.54 | 50.97 | |
| Linear2025.05 | 70.85 | 50.28 | |
| Graphk=1002025.05 | 70.85 | 48.22 | |
| D-Attnk=1002025.05 | 70.12 | 50.97 | |
| D-Attnk=102025.05 | 67.27 | 48.87 | |
| Attnk=102025.05 | 66.57 | 46.1 | |
| kNNk=102025.05 | 65.88 | 49.57 | |
| Graphk=102025.05 | 64.48 | 44.71 | |
| LinearMF=true2025.05 | 64.46 | 48.2 | |
| MLPMF=true2025.05 | 64.45 | 49.61 | |
| MLP2025.05 | 60.2 | 48.89 | |
| Random2025.05 | 52.91 | 36.96 | |
| MLProuting=selection based2025.05 | 42.46 | 32.82 | |
| Attnk=100, routing=selection based2025.05 | 41.61 | 33.87 | |
| Attnk=10, routing=selection based2025.05 | 39.1 | 28.21 | |
| kNNk=10, routing=selection based2025.05 | 34.48 | 24.69 | |
| Graphk=100, routing=selection based2025.05 | 33.63 | 33.06 | |
| Linear (MF)matrix factorization=true, routing=selection based2025.05 | 32.6 | 30.24 | |
| Graphk=10, routing=selection based2025.05 | 32.11 | 24.7 | |
| D-Attnk=10, routing=selection based2025.05 | 30.42 | 29.75 | |
| D-Attnk=100, routing=selection based2025.05 | 29.72 | 48.46 | |
| kNNk=100, routing=selection based2025.05 | 23.39 | 24.23 | |
| Linearrouting=selection based2025.05 | 23.39 | 24.92 | |
| MLP (MF)matrix factorization=true, routing=selection based2025.05 | 23.39 | 33.07 |