# Federated Learning Fairness on Fashion MNIST (test) Source: [Federated Learning Fairness on Fashion MNIST (test)]() Collection index: [llms.txt]() Data updated: 2026-02-27T12:15:00.676Z Evaluation of fairness metrics, such as variance in accuracy across clients, in Federated Learning settings using the test split of the Fashion MNIST dataset. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Federated Learning Fairness | | Dataset (including any stated split) | Fashion MNIST (test) | | Metric | Accuracy Variance | | Unit | SCALAR | | Direction | Lower is better | | Results loaded | 28 of 28 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy Variance](): Lower is better; unit: SCALAR. - [Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy Variance | Result date | Report paper | | --- | --- | --- | --- | | DFedReweighting | 1.005 | Not recorded | 6940e79b456146936284f7e8 | | q-FDFL | 1.151 | Not recorded | 6940e79b456146936284f7e8 | | q-FDFL | 1.153 | Not recorded | 6940e79b456146936284f7e8 | | DFedReweighting | 1.196 | Not recorded | 6940e79b456146936284f7e8 | | q-FDFL | 1.237 | Not recorded | 6940e79b456146936284f7e8 | | DFedReweighting | 1.243 | Not recorded | 6940e79b456146936284f7e8 | | DFedAvg | 1.455 | Not recorded | 6940e79b456146936284f7e8 | | DFedReweighting | 10.452 | Not recorded | 6940e79b456146936284f7e8 | | DFedReweighting | 11.976 | Not recorded | 6940e79b456146936284f7e8 | | DFedReweighting | 13.422 | Not recorded | 6940e79b456146936284f7e8 | | DFedReweighting | 14.253 | Not recorded | 6940e79b456146936284f7e8 | | DFedReweighting | 15.876 | Not recorded | 6940e79b456146936284f7e8 | | DFedReweighting | 16.657 | Not recorded | 6940e79b456146936284f7e8 | | DFedReweighting | 17.589 | Not recorded | 6940e79b456146936284f7e8 | | q-FDFL | 18.012 | Not recorded | 6940e79b456146936284f7e8 | | q-FDFL | 18.02 | Not recorded | 6940e79b456146936284f7e8 | | q-FDFL | 20.125 | Not recorded | 6940e79b456146936284f7e8 | | DFedAvg | 22.61 | Not recorded | 6940e79b456146936284f7e8 | | DFedReweighting | 35.302 | Not recorded | 6940e79b456146936284f7e8 | | q-FDFL | 147.575 | Not recorded | 6940e79b456146936284f7e8 | | DFedReweighting | 161.933 | Not recorded | 6940e79b456146936284f7e8 | | DFedAvg | 184.043 | Not recorded | 6940e79b456146936284f7e8 | | q-FDFL | 199.828 | Not recorded | 6940e79b456146936284f7e8 | | q-FDFL | 215.891 | Not recorded | 6940e79b456146936284f7e8 | | q-FDFL | 335.066 | Not recorded | 6940e79b456146936284f7e8 | | DFedAvg | 360.772 | Not recorded | 6940e79b456146936284f7e8 | | q-FDFL | 414.974 | Not recorded | 6940e79b456146936284f7e8 | | q-FDFL | 429.66 | Not recorded | 6940e79b456146936284f7e8 | ### DFedReweighting Accuracy Variance: 1.005. Result ID: 69a18ab035dfcabb00e7be1a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"IID","T":"0.01"}. This record does not assert independent reproduction. ### q-FDFL Accuracy Variance: 1.151. Result ID: 69a18ab035dfcabb00e7be18. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"IID","q":"0.01"}. This record does not assert independent reproduction. ### q-FDFL Accuracy Variance: 1.153. Result ID: 69a18ab035dfcabb00e7be19. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"IID","q":"0.5"}. This record does not assert independent reproduction. ### DFedReweighting Accuracy Variance: 1.196. Result ID: 69a18ab035dfcabb00e7be1c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"IID","T":"0.5"}. This record does not assert independent reproduction. ### q-FDFL Accuracy Variance: 1.237. Result ID: 69a18ab035dfcabb00e7be17. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"IID","q":"0.1"}. This record does not assert independent reproduction. ### DFedReweighting Accuracy Variance: 1.243. Result ID: 69a18ab035dfcabb00e7be1b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"IID","T":"0.1"}. This record does not assert independent reproduction. ### DFedAvg Accuracy Variance: 1.455. Result ID: 69a18ab035dfcabb00e7be16. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"IID"}. This record does not assert independent reproduction. ### DFedReweighting Accuracy Variance: 10.452. Result ID: 69a18ab035dfcabb00e7be29. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"Diri(1.0)","T":"0.1"}. This record does not assert independent reproduction. ### DFedReweighting Accuracy Variance: 11.976. Result ID: 69a18ab035dfcabb00e7be2a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"Diri(1.0)","T":"0.5"}. This record does not assert independent reproduction. ### DFedReweighting Accuracy Variance: 13.422. Result ID: 69a18ab035dfcabb00e7be22. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"Diri(0.1)","T":"0.1"}. This record does not assert independent reproduction. ### DFedReweighting Accuracy Variance: 14.253. Result ID: 69a18ab035dfcabb00e7be28. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"Diri(1.0)","T":"0.01"}. This record does not assert independent reproduction. ### DFedReweighting Accuracy Variance: 15.876. Result ID: 69a18ab035dfcabb00e7be30. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"LabelSkew(4)","T":"0.1"}. This record does not assert independent reproduction. ### DFedReweighting Accuracy Variance: 16.657. Result ID: 69a18ab035dfcabb00e7be21. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"Diri(0.1)","T":"0.01"}. This record does not assert independent reproduction. ### DFedReweighting Accuracy Variance: 17.589. Result ID: 69a18ab035dfcabb00e7be2f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"LabelSkew(4)","T":"0.01"}. This record does not assert independent reproduction. ### q-FDFL Accuracy Variance: 18.012. Result ID: 69a18ab035dfcabb00e7be26. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"Diri(1.0)","q":"0.01"}. This record does not assert independent reproduction. ### q-FDFL Accuracy Variance: 18.02. Result ID: 69a18ab035dfcabb00e7be25. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"Diri(1.0)","q":"0.1"}. This record does not assert independent reproduction. ### q-FDFL Accuracy Variance: 20.125. Result ID: 69a18ab035dfcabb00e7be27. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"Diri(1.0)","q":"0.5"}. This record does not assert independent reproduction. ### DFedAvg Accuracy Variance: 22.61. Result ID: 69a18ab035dfcabb00e7be24. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"Diri(1.0)"}. This record does not assert independent reproduction. ### DFedReweighting Accuracy Variance: 35.302. Result ID: 69a18ab035dfcabb00e7be31. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"LabelSkew(4)","T":"0.5"}. This record does not assert independent reproduction. ### q-FDFL Accuracy Variance: 147.575. Result ID: 69a18ab035dfcabb00e7be2d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"LabelSkew(4)","q":"0.01"}. This record does not assert independent reproduction. ### DFedReweighting Accuracy Variance: 161.933. Result ID: 69a18ab035dfcabb00e7be23. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"Diri(0.1)","T":"0.5"}. This record does not assert independent reproduction. ### DFedAvg Accuracy Variance: 184.043. Result ID: 69a18ab035dfcabb00e7be2b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"LabelSkew(4)"}. This record does not assert independent reproduction. ### q-FDFL Accuracy Variance: 199.828. Result ID: 69a18ab035dfcabb00e7be2c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"LabelSkew(4)","q":"0.1"}. This record does not assert independent reproduction. ### q-FDFL Accuracy Variance: 215.891. Result ID: 69a18ab035dfcabb00e7be2e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"LabelSkew(4)","q":"0.5"}. This record does not assert independent reproduction. ### q-FDFL Accuracy Variance: 335.066. Result ID: 69a18ab035dfcabb00e7be1e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"Diri(0.1)","q":"0.1"}. This record does not assert independent reproduction. ### DFedAvg Accuracy Variance: 360.772. Result ID: 69a18ab035dfcabb00e7be1d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"Diri(0.1)"}. This record does not assert independent reproduction. ### q-FDFL Accuracy Variance: 414.974. Result ID: 69a18ab035dfcabb00e7be20. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"Diri(0.1)","q":"0.5"}. This record does not assert independent reproduction. ### q-FDFL Accuracy Variance: 429.66. Result ID: 69a18ab035dfcabb00e7be1f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Data Heterogeneity (DH)":"Diri(0.1)","q":"0.01"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.