Response Prediction on WorldValuesBench (held-out)
0.977Log Lossnonadaptive
Evaluation Results
| Method | Links | |
|---|---|---|
| nonadaptiveQuery Budget (T)=202026.05 | 0.977 | |
| nonadaptiveQuery Budget (T)=302026.05 | 0.981 | |
| nonadaptiveQuery Budget (T)=502026.05 | 0.988 | |
| nonadaptiveQuery Budget (T)=152026.05 | 0.991 | |
| greedyQuery Budget (T)=302026.05 | 0.997 | |
| randomQuery Budget (T)=862026.05 | 0.998 | |
| random_fixedQuery Budget (T)=862026.05 | 0.998 | |
| nonadaptiveQuery Budget (T)=862026.05 | 0.998 | |
| greedyQuery Budget (T)=502026.05 | 0.998 | |
| greedyQuery Budget (T)=862026.05 | 0.998 | |
| greedyQuery Budget (T)=202026.05 | 0.999 | |
| randomQuery Budget (T)=502026.05 | 1 | |
| greedyQuery Budget (T)=152026.05 | 1.001 | |
| randomQuery Budget (T)=302026.05 | 1.005 | |
| CAT-GRMQuery Budget (T)=862026.05 | 1.005 | |
| greedyQuery Budget (T)=102026.05 | 1.006 | |
| CAT-MGRMQuery Budget (T)=862026.05 | 1.006 | |
| randomQuery Budget (T)=202026.05 | 1.01 | |
| CAT-MGRMQuery Budget (T)=302026.05 | 1.011 | |
| CAT-MGRMQuery Budget (T)=502026.05 | 1.011 | |
| random_fixedQuery Budget (T)=502026.05 | 1.012 | |
| randomQuery Budget (T)=152026.05 | 1.015 | |
| CAT-MGRMQuery Budget (T)=202026.05 | 1.015 | |
| greedyQuery Budget (T)=52026.05 | 1.019 | |
| CAT-GRMQuery Budget (T)=502026.05 | 1.019 | |
| nonadaptiveQuery Budget (T)=102026.05 | 1.02 | |
| randomQuery Budget (T)=102026.05 | 1.022 | |
| CAT-MGRMQuery Budget (T)=152026.05 | 1.022 | |
| random_fixedQuery Budget (T)=102026.05 | 1.028 | |
| CAT-GRMQuery Budget (T)=302026.05 | 1.031 | |
| CAT-MGPCMQuery Budget (T)=862026.05 | 1.032 | |
| randomQuery Budget (T)=52026.05 | 1.033 | |
| CAT-GPCMQuery Budget (T)=862026.05 | 1.033 | |
| CAT-MGRMQuery Budget (T)=102026.05 | 1.033 | |
| random_fixedQuery Budget (T)=152026.05 | 1.036 | |
| random_fixedQuery Budget (T)=202026.05 | 1.036 | |
| random_fixedQuery Budget (T)=302026.05 | 1.037 | |
| CAT-MGPCMQuery Budget (T)=502026.05 | 1.038 | |
| nonadaptiveQuery Budget (T)=52026.05 | 1.039 | |
| random_fixedQuery Budget (T)=52026.05 | 1.04 | |
| CAT-MGRMQuery Budget (T)=52026.05 | 1.044 | |
| CAT-GRMQuery Budget (T)=202026.05 | 1.046 | |
| CAT-GPCMQuery Budget (T)=502026.05 | 1.048 | |
| CAT-MGPCMQuery Budget (T)=302026.05 | 1.051 | |
| CAT-GRMQuery Budget (T)=152026.05 | 1.058 | |
| CAT-MGPCMQuery Budget (T)=202026.05 | 1.066 | |
| CAT-GRMQuery Budget (T)=102026.05 | 1.067 | |
| CAT-GPCMQuery Budget (T)=302026.05 | 1.067 | |
| CAT-MGPCMQuery Budget (T)=152026.05 | 1.071 | |
| CAT-GRMQuery Budget (T)=52026.05 | 1.074 | |
| CAT-MGPCMQuery Budget (T)=102026.05 | 1.083 | |
| CAT-GPCMQuery Budget (T)=202026.05 | 1.092 | |
| CAT-GPCMQuery Budget (T)=152026.05 | 1.104 | |
| CAT-MGPCMQuery Budget (T)=52026.05 | 1.107 | |
| CAT-GPCMQuery Budget (T)=102026.05 | 1.122 | |
| CAT-GPCMQuery Budget (T)=52026.05 | 1.149 |