Ordinal Prediction on WorldValuesBench (held-out users)
0.54Ordinal MSEnonadaptive
Evaluation Results
| Method | Links | |
|---|---|---|
| nonadaptiveQuery Budget (T)=202026.05 | 0.54 | |
| nonadaptiveQuery Budget (T)=302026.05 | 0.545 | |
| nonadaptiveQuery Budget (T)=502026.05 | 0.552 | |
| nonadaptiveQuery Budget (T)=152026.05 | 0.555 | |
| randomQuery Budget (T)=862026.05 | 0.562 | |
| random_fixedQuery Budget (T)=862026.05 | 0.562 | |
| nonadaptiveQuery Budget (T)=862026.05 | 0.562 | |
| greedyQuery Budget (T)=502026.05 | 0.562 | |
| greedyQuery Budget (T)=862026.05 | 0.562 | |
| greedyQuery Budget (T)=302026.05 | 0.563 | |
| randomQuery Budget (T)=502026.05 | 0.567 | |
| greedyQuery Budget (T)=202026.05 | 0.567 | |
| greedyQuery Budget (T)=152026.05 | 0.571 | |
| randomQuery Budget (T)=302026.05 | 0.575 | |
| greedyQuery Budget (T)=102026.05 | 0.577 | |
| randomQuery Budget (T)=202026.05 | 0.582 | |
| random_fixedQuery Budget (T)=502026.05 | 0.583 | |
| randomQuery Budget (T)=152026.05 | 0.59 | |
| greedyQuery Budget (T)=52026.05 | 0.594 | |
| CAT-GRMQuery Budget (T)=862026.05 | 0.594 | |
| CAT-MGRMQuery Budget (T)=862026.05 | 0.597 | |
| nonadaptiveQuery Budget (T)=102026.05 | 0.598 | |
| CAT-GPCMQuery Budget (T)=862026.05 | 0.598 | |
| randomQuery Budget (T)=102026.05 | 0.6 | |
| CAT-MGPCMQuery Budget (T)=862026.05 | 0.601 | |
| CAT-MGRMQuery Budget (T)=502026.05 | 0.605 | |
| CAT-MGPCMQuery Budget (T)=502026.05 | 0.606 | |
| CAT-MGRMQuery Budget (T)=302026.05 | 0.608 | |
| CAT-GRMQuery Budget (T)=502026.05 | 0.61 | |
| CAT-GPCMQuery Budget (T)=502026.05 | 0.61 | |
| CAT-MGRMQuery Budget (T)=202026.05 | 0.612 | |
| random_fixedQuery Budget (T)=102026.05 | 0.613 | |
| randomQuery Budget (T)=52026.05 | 0.616 | |
| CAT-MGPCMQuery Budget (T)=302026.05 | 0.616 | |
| CAT-MGRMQuery Budget (T)=152026.05 | 0.62 | |
| random_fixedQuery Budget (T)=152026.05 | 0.623 | |
| random_fixedQuery Budget (T)=202026.05 | 0.623 | |
| random_fixedQuery Budget (T)=302026.05 | 0.623 | |
| nonadaptiveQuery Budget (T)=52026.05 | 0.625 | |
| CAT-GRMQuery Budget (T)=302026.05 | 0.626 | |
| random_fixedQuery Budget (T)=52026.05 | 0.627 | |
| CAT-GPCMQuery Budget (T)=302026.05 | 0.628 | |
| CAT-MGPCMQuery Budget (T)=202026.05 | 0.632 | |
| CAT-MGRMQuery Budget (T)=102026.05 | 0.634 | |
| CAT-MGPCMQuery Budget (T)=152026.05 | 0.637 | |
| CAT-GRMQuery Budget (T)=202026.05 | 0.644 | |
| CAT-MGRMQuery Budget (T)=52026.05 | 0.646 | |
| CAT-MGPCMQuery Budget (T)=102026.05 | 0.65 | |
| CAT-GPCMQuery Budget (T)=202026.05 | 0.651 | |
| CAT-GRMQuery Budget (T)=152026.05 | 0.659 | |
| CAT-GPCMQuery Budget (T)=152026.05 | 0.663 | |
| CAT-GRMQuery Budget (T)=102026.05 | 0.672 | |
| CAT-MGPCMQuery Budget (T)=52026.05 | 0.676 | |
| CAT-GRMQuery Budget (T)=52026.05 | 0.681 | |
| CAT-GPCMQuery Budget (T)=102026.05 | 0.684 | |
| CAT-GPCMQuery Budget (T)=52026.05 | 0.714 |