# Image Classification on Fashion-MNIST Dir(0.5) (test) Source: [Image Classification on Fashion-MNIST Dir(0.5) (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:30:02.377Z Evaluation of Image Classification performance on the test split of the Fashion-MNIST dataset using the Dir(0.5) configuration. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Image Classification | | Dataset (including any stated split) | Fashion-MNIST Dir(0.5) (test) | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 28 of 28 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | AdapFedAvg | 90.49 | Not recorded | 68fa755d1e209131cea6780b | | FedProx | 90.48 | Not recorded | 68fa755d1e209131cea6780b | | FedAvg | 90.38 | Not recorded | 68fa755d1e209131cea6780b | | FedFM | 90.37 | Not recorded | 68fa755d1e209131cea6780b | | FedCCFA | 90.31 | Not recorded | 68fa755d1e209131cea6780b | | Ditto | 90.26 | Not recorded | 68fa755d1e209131cea6780b | | SCAFFOLD | 90.22 | Not recorded | 68fa755d1e209131cea6780b | | FedFM | 90.21 | Not recorded | 68fa755d1e209131cea6780b | | FedProx | 90.15 | Not recorded | 68fa755d1e209131cea6780b | | AdapFedAvg | 90.08 | Not recorded | 68fa755d1e209131cea6780b | | Flash | 90.04 | Not recorded | 68fa755d1e209131cea6780b | | FedAvg | 90.02 | Not recorded | 68fa755d1e209131cea6780b | | Ditto | 89.93 | Not recorded | 68fa755d1e209131cea6780b | | Flash | 89.85 | Not recorded | 68fa755d1e209131cea6780b | | FedCCFA | 89.67 | Not recorded | 68fa755d1e209131cea6780b | | FedDrift | 89.43 | Not recorded | 68fa755d1e209131cea6780b | | IFCA | 88.51 | Not recorded | 68fa755d1e209131cea6780b | | FedDrift | 88.29 | Not recorded | 68fa755d1e209131cea6780b | | FedPAC | 87.5 | Not recorded | 68fa755d1e209131cea6780b | | SCAFFOLD | 87.36 | Not recorded | 68fa755d1e209131cea6780b | | IFCA | 86.96 | Not recorded | 68fa755d1e209131cea6780b | | pFedMe | 85.43 | Not recorded | 68fa755d1e209131cea6780b | | FedPAC | 85.26 | Not recorded | 68fa755d1e209131cea6780b | | pFedMe | 84.77 | Not recorded | 68fa755d1e209131cea6780b | | FedBABU | 81.41 | Not recorded | 68fa755d1e209131cea6780b | | FedRep | 81.29 | Not recorded | 68fa755d1e209131cea6780b | | FedBABU | 80.85 | Not recorded | 68fa755d1e209131cea6780b | | FedRep | 33.7 | Not recorded | 68fa755d1e209131cea6780b | ### AdapFedAvg Accuracy: 90.49. Result ID: 6993ab633a6c31484917b145. [Reporting paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### FedProx Accuracy: 90.48. Result ID: 6993ab633a6c31484917b13f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### FedAvg Accuracy: 90.38. Result ID: 6993ab633a6c31484917b13d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### FedFM Accuracy: 90.37. Result ID: 6993ab633a6c31484917b143. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### FedCCFA Accuracy: 90.31. Result ID: 6993ab633a6c31484917b157. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### Ditto Accuracy: 90.26. Result ID: 6993ab633a6c31484917b14b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### SCAFFOLD Accuracy: 90.22. Result ID: 6993ab633a6c31484917b141. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### FedFM Accuracy: 90.21. Result ID: 6993ab633a6c31484917b144. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### FedProx Accuracy: 90.15. Result ID: 6993ab633a6c31484917b140. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### AdapFedAvg Accuracy: 90.08. Result ID: 6993ab633a6c31484917b146. [Reporting paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### Flash Accuracy: 90.04. Result ID: 6993ab633a6c31484917b147. [Reporting paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### FedAvg Accuracy: 90.02. Result ID: 6993ab633a6c31484917b13e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### Ditto Accuracy: 89.93. Result ID: 6993ab633a6c31484917b14c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### Flash Accuracy: 89.85. Result ID: 6993ab633a6c31484917b148. [Reporting paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### FedCCFA Accuracy: 89.67. Result ID: 6993ab633a6c31484917b158. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### FedDrift Accuracy: 89.43. Result ID: 6993ab633a6c31484917b156. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### IFCA Accuracy: 88.51. Result ID: 6993ab633a6c31484917b154. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### FedDrift Accuracy: 88.29. Result ID: 6993ab633a6c31484917b155. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### FedPAC Accuracy: 87.5. Result ID: 6993ab633a6c31484917b152. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### SCAFFOLD Accuracy: 87.36. Result ID: 6993ab633a6c31484917b142. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### IFCA Accuracy: 86.96. Result ID: 6993ab633a6c31484917b153. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### pFedMe Accuracy: 85.43. Result ID: 6993ab633a6c31484917b149. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### FedPAC Accuracy: 85.26. Result ID: 6993ab633a6c31484917b151. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### pFedMe Accuracy: 84.77. Result ID: 6993ab633a6c31484917b14a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### FedBABU Accuracy: 81.41. Result ID: 6993ab633a6c31484917b150. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### FedRep Accuracy: 81.29. Result ID: 6993ab633a6c31484917b14e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### FedBABU Accuracy: 80.85. Result ID: 6993ab633a6c31484917b14f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%","Drift type":"reoccurring"}. This record does not assert independent reproduction. ### FedRep Accuracy: 33.7. Result ID: 6993ab633a6c31484917b14d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%","Drift type":"reoccurring"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.