List your company
ResearchFormerly WizWand

Preference Learning on Toy dataset 0% label noise (test)

99.6AccuracySimPO
57.37668.33879.390.262Oct 28, 2025
Updated 8mo ago

Evaluation results

MethodLinks
SimPOnL=100002025.1099.6
SSPOthreshold=0.5, nL=100002025.1099.6
DPOnL=100002025.1099.5
SSPOthreshold=0.3, nL=100002025.1099.3
SSPOthreshold=0.1, nL=100002025.1099.2
SSPOthreshold=0.7, nL=100002025.1099.1
SSPOthreshold=0.9, nL=100002025.1099.1
DPOnL=10002025.1098.6
SSPOthreshold=0.1, nL=10002025.1098.6
SSPOthreshold=0.9, nL=10002025.1098.6
SSPOthreshold=0.7, nL=10002025.1098.5
SSPOthreshold=0.3, nL=10002025.1098.3
SSPOthreshold=0.5, nL=10002025.1098.3
SimPOnL=10002025.1098.1
SSPOthreshold=0.7, nL=1002025.1096.6
SSPOprior=0.7, n_L=100, n_U=10002025.1096.6
SSPOthreshold=0.1, nL=1002025.1096.5
SSPOthreshold=0.9, nL=1002025.1096.5
SSPOprior=0.1, n_L=100, n_U=10002025.1096.5
SSPOprior=0.9, n_L=100, n_U=10002025.1096.5
SSPOprior=0.5, number of paired samples (n_L)=1002025.1096
SSPOthreshold=0.5, nL=1002025.1096
SSPOprior=0.5, n_L=100, n_U=10002025.1096
SSPOthreshold=0.3, nL=1002025.1095.5
SSPOprior=0.3, n_L=100, n_U=10002025.1095.5
ORPOnL=100002025.1093.4
SSPOthreshold=0.1, nL=502025.1091
SSPOprior=0.1, n_L=50, n_U=10002025.1091
SSPOthreshold=0.3, nL=502025.1088.9
SSPOprior=0.3, n_L=50, n_U=10002025.1088.9
SSPOprior=0.5, number of paired samples (n_L)=502025.1087.9
SSPOthreshold=0.5, nL=502025.1087.9
SSPOprior=0.5, n_L=50, n_U=10002025.1087.9
SSPOthreshold=0.9, nL=502025.1086.1
SSPOprior=0.9, n_L=50, n_U=10002025.1086.1
SSPOthreshold=0.7, nL=502025.1085.7
SSPOprior=0.7, n_L=50, n_U=10002025.1085.7
DPOnumber of paired samples (n_L)=1002025.1084.6
DPOnL=1002025.1084.6
DPOn_L=100, n_U=10002025.1084.6
SSPOprior=0.5, number of paired samples (n_L)=102025.1084.1
SSPOthreshold=0.5, nL=102025.1084.1
SSPOprior=0.5, n_L=10, n_U=10002025.1084.1
SSPOthreshold=0.9, nL=102025.1084
SSPOprior=0.9, n_L=10, n_U=10002025.1084
ORPOnL=10002025.1083.2
SSPOthreshold=0.1, nL=102025.1082.2
SSPOprior=0.1, n_L=10, n_U=10002025.1082.2
SimPOnumber of paired samples (n_L)=1002025.1081.7
SimPOnL=1002025.1081.7
SimPOn_L=100, n_U=10002025.1081.7
SSPOthreshold=0.3, nL=102025.1081
SSPOprior=0.3, n_L=10, n_U=10002025.1081
SSPOthreshold=0.7, nL=102025.1080
SSPOprior=0.7, n_L=10, n_U=10002025.1080
DPOnumber of paired samples (n_L)=502025.1077.7
DPOnL=502025.1077.7
DPOn_L=50, n_U=10002025.1077.7
SimPOnumber of paired samples (n_L)=502025.1077.6
SimPOnL=502025.1077.6
SimPOn_L=50, n_U=10002025.1077.6
SimPOnumber of paired samples (n_L)=102025.1076.2
SimPOnL=102025.1076.2
SimPOn_L=10, n_U=10002025.1076.2
DPOnumber of paired samples (n_L)=102025.1074.3
DPOnL=102025.1074.3
DPOn_L=10, n_U=10002025.1074.3
ORPOnumber of paired samples (n_L)=1002025.1071
ORPOnL=1002025.1071
ORPOn_L=100, n_U=10002025.1071
ORPOnumber of paired samples (n_L)=502025.1067.9
ORPOnL=502025.1067.9
ORPOn_L=50, n_U=10002025.1067.9
ORPOnumber of paired samples (n_L)=102025.1059
ORPOnL=102025.1059
ORPOn_L=10, n_U=10002025.1059