Preference Evaluation on Mturk user study Overall Preferences 1.0
76Overall Preference FractionPolicy R1
Evaluation Results
| Method | Links | |
|---|---|---|
| Policy R1Reference Policy=B2021.05 | 76 | |
| Policy CReference Policy=A2021.05 | 75 | |
| Policy R2Reference Policy=B2021.05 | 73 | |
| Policy CReference Policy=B2021.05 | 70 | |
| Policy EReference Policy=A2021.05 | 66 | |
| Policy R1Reference Policy=A2021.05 | 66 | |
| Policy R2Reference Policy=A2021.05 | 66 | |
| Policy R2Reference Policy=C2021.05 | 66 | |
| Policy BReference Policy=A2021.05 | 61 | |
| Policy CReference Policy=E2021.05 | 61 | |
| Policy R1Reference Policy=D2021.05 | 59 | |
| Policy CReference Policy=D2021.05 | 57 | |
| Policy DReference Policy=A2021.05 | 57 | |
| Policy R2Reference Policy=D2021.05 | 56 | |
| Policy EReference Policy=D2021.05 | 52 | |
| Policy R2Reference Policy=E2021.05 | 51 | |
| Policy BReference Policy=D2021.05 | 50 | |
| Policy BReference Policy=E2021.05 | 50 | |
| Policy DReference Policy=B2021.05 | 50 | |
| Policy EReference Policy=B2021.05 | 50 | |
| Policy DReference Policy=E2021.05 | 48 | |
| Policy AReference Policy=D2021.05 | 43 | |
| Policy DReference Policy=C2021.05 | 43 | |
| Policy AReference Policy=B2021.05 | 39 | |
| Policy EReference Policy=C2021.05 | 39 | |
| Policy R1Reference Policy=E2021.05 | 39 | |
| Policy AReference Policy=E2021.05 | 34 | |
| Policy BReference Policy=C2021.05 | 30 | |
| Policy R1Reference Policy=C2021.05 | 29 | |
| Policy AReference Policy=C2021.05 | 25 |