Evidence Retrieval on FEVER frozen 100-client instance (held-out)
55AccuracyFedMark-FM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| FedMark-FMCalls=351, Budget=fixed2026.07 | 55 | 0.126 | 100 | 0 | |
| EqualCalls=0, Budget=fixed2026.07 | 51.7 | 0.116 | 100 | 0 | |
| Shapley-UCBCalls=351, Budget=fixed2026.07 | 51.7 | 0.117 | 100 | 0.33 | |
| Retrieval similarityCalls=0, Budget=fixed2026.07 | 44.2 | 0.1 | 67 | 0.33 | |
| Leave-one-outCalls=117, Budget=fixed2026.07 | 10.8 | 0.025 | 33 | 10.67 | |
| VolumeCalls=0, Budget=fixed2026.07 | 9.2 | 0.02 | 0 | 12 | |
| FL-ShapleyCalls=351, Budget=fixed2026.07 | 7.5 | 0.017 | 0 | 4.67 |