List your company

Preference Alignment on Psoups (test)

1.39Helpfulness (RM)MetaAligner
-0.8044-0.23470.3350.9047Apr 17, 2025

Evaluation results

MethodLinks
MetaAlignerMulti-objective=true, Policy-agnostic=true, Generalizability=true, Training-free=true, Free from RM=false2025.041.390.55660.890.54740.84
AlignerMulti-objective=true, Policy-agnostic=true, Generalizability=true, Training-free=true, Free from RM=false2025.041.320.67720.970.63700.9
Persona-judgeMulti-objective=true, Policy-agnostic=true, Generalizability=true, Training-free=true, Free from RM=true2025.041.290.63840.980.82980.93
Persona-judge-BaseMulti-objective=false, Policy-agnostic=false, Generalizability=true, Training-free=true, Free from RM=true2025.041.210.59801.010.79880.9
SteeringMulti-objective=true, Policy-agnostic=true, Generalizability=true, Training-free=true, Free from RM=false2025.041.170.63380.960.81660.89
ArgsMulti-objective=false, Policy-agnostic=false, Generalizability=true, Training-free=true, Free from RM=true2025.041.09—74—0.98940.9
BaseMulti-objective=false, Policy-agnostic=false, Generalizability=false, Training-free=false, Free from RM=false2025.041.060.61—0.970.83—0.87
MODMulti-objective=true, Policy-agnostic=true, Generalizability=true, Training-free=true, Free from RM=false2025.040.930.55600.960.92840.84
MORLHFMulti-objective=true, Policy-agnostic=false, Generalizability=false, Training-free=false, Free from RM=false2025.040.910.31140.880.8440.73
RiCMulti-objective=true, Policy-agnostic=true, Generalizability=true, Training-free=true, Free from RM=false2025.040.90.54400.970.9700.83
MODPOMulti-objective=true, Policy-agnostic=false, Generalizability=false, Training-free=false, Free from RM=false2025.040.890.56520.960.77800.8
Rewarded soupsMulti-objective=true, Policy-agnostic=false, Generalizability=false, Training-free=true, Free from RM=false2025.040.870.5340.950.87640.8
Personalized soupsMulti-objective=true, Policy-agnostic=false, Generalizability=false, Training-free=true, Free from RM=false2025.04-0.720.38720.920.73920.53