Data Valuation and Coalition Selection on FEVER market scale RAG track (test)
92.6QualityFL-Shapley
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| FL-ShapleyClients=204, Calls=816, Runtime (s)=0.00922026.07 | 92.6 | 2.56 | |
| FedMark-FMClients=204, Calls=816, Runtime (s)=0.00922026.07 | 90.56 | 3.26 | |
| FL-ShapleyClients=504, Calls=1008, Runtime (s)=0.02562026.07 | 82.9 | 7.94 | |
| FedMark-FMClients=504, Calls=1008, Runtime (s)=0.02562026.07 | 81.7 | 8.51 | |
| VolumeClients=204, Calls=0, Runtime (s)=0.00012026.07 | 66.58 | 11.54 | |
| FL-ShapleyClients=1004, Calls=2008, Runtime (s)=0.08192026.07 | 63.31 | 17.48 | |
| VolumeClients=504, Calls=0, Runtime (s)=0.00022026.07 | 59.68 | 18.76 | |
| FedMark-FMClients=1004, Calls=2008, Runtime (s)=0.08192026.07 | 52.6 | 22.57 | |
| VolumeClients=1004, Calls=0, Runtime (s)=0.00032026.07 | 45.17 | 26.11 |