Federated Value Alignment (Direct Preference Optimization) on HH-RLHF (test)
0.6866LossFedACT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| FedACTCommunication Rounds=200, Number of Clients=5, Participation Rate=40%, Batch Size=16, K (Local Iterations)=102026.07 | 0.6866 | 55.95 | 0.0147 | 0.2656 | |
| FedAvgCommunication Rounds=200, Number of Clients=5, Participation Rate=40%, Batch Size=16, K (Local Iterations)=102026.07 | 0.688 | 55.59 | 0.0113 | 0.2308 | |
| FedProxCommunication Rounds=200, Number of Clients=5, Participation Rate=40%, Batch Size=16, K (Local Iterations)=102026.07 | 0.6881 | 55.54 | 0.0113 | 0.2309 | |
| SCAFFOLDCommunication Rounds=200, Number of Clients=5, Participation Rate=40%, Batch Size=16, K (Local Iterations)=102026.07 | 0.6888 | 55.61 | 0.0094 | 0.2122 | |
| FedAdamWCommunication Rounds=200, Number of Clients=5, Participation Rate=40%, Batch Size=16, K (Local Iterations)=102026.07 | 0.6891 | 54.9 | 0.009 | 0.208 | |
| FedAdamCommunication Rounds=200, Number of Clients=5, Participation Rate=40%, Batch Size=16, K (Local Iterations)=102026.07 | 0.6895 | 55.04 | 0.008 | 0.1977 | |
| FedLADACommunication Rounds=200, Number of Clients=5, Participation Rate=40%, Batch Size=16, K (Local Iterations)=102026.07 | 0.6902 | 54.31 | 0.0064 | 0.182 | |
| BaseCommunication Rounds=200, Number of Clients=5, Participation Rate=40%, Batch Size=16, K (Local Iterations)=102026.07 | 0.6931 | — | 0 | 0.1182 |