Downstream Task Accuracy on FEVER card (test)
63.3Accuracy (FEVER card)FedMark-FM
Evaluation Results
| Method | Links | |
|---|---|---|
| FedMark-FMNumber of clients=2002026.07 | 63.3 | |
| Shapley-UCBNumber of clients=2002026.07 | 59.2 | |
| Shapley-UCBNumber of clients=1002026.07 | 54.5 | |
| FedMark-FMNumber of clients=1002026.07 | 54 | |
| EqualNumber of clients=2002026.07 | 51.7 | |
| EqualNumber of clients=1002026.07 | 50 | |
| Retrieval similarityNumber of clients=2002026.07 | 48.3 | |
| EqualNumber of clients=502026.07 | 47.5 | |
| Retrieval similarityNumber of clients=1002026.07 | 46.5 | |
| FedMark-FMNumber of clients=502026.07 | 46.5 | |
| Shapley-UCBNumber of clients=502026.07 | 45.5 | |
| Retrieval similarityNumber of clients=502026.07 | 42 | |
| FL-ShapleyNumber of clients=502026.07 | 20.5 | |
| Leave-one-outNumber of clients=2002026.07 | 13.3 | |
| FL-ShapleyNumber of clients=2002026.07 | 10.8 | |
| VolumeNumber of clients=2002026.07 | 10 | |
| Leave-one-outNumber of clients=1002026.07 | 10 | |
| FL-ShapleyNumber of clients=1002026.07 | 9.5 | |
| VolumeNumber of clients=1002026.07 | 9 | |
| Leave-one-outNumber of clients=502026.07 | 8.5 | |
| VolumeNumber of clients=502026.07 | 7 |