# Image Classification on Fashion-MNIST (sudden drift and Dir(0.1) 1.0 (test)) Source: [Image Classification on Fashion-MNIST (sudden drift and Dir(0.1) 1.0 (test))]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:34:17.089Z Evaluation of Image Classification performance on the Fashion-MNIST dataset subjected to sudden distribution drift under the Dir(0.1) configuration at time step 1.0, using the test set. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Image Classification | | Dataset (including any stated split) | Fashion-MNIST under sudden drift and Dir(0.1) 1.0 (test) | | Metric | Accuracy (Generalized) | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 28 of 28 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy (Generalized)](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy (Generalized) | Result date | Report paper | | --- | --- | --- | --- | | FedCCFA | 87.63 | Not recorded | 68fa755d1e209131cea6780b | | FedCCFA | 85.22 | Not recorded | 68fa755d1e209131cea6780b | | IFCA | 82.9 | Not recorded | 68fa755d1e209131cea6780b | | FedDrift | 80.48 | Not recorded | 68fa755d1e209131cea6780b | | FedPAC | 79.96 | Not recorded | 68fa755d1e209131cea6780b | | FedBABU | 76.93 | Not recorded | 68fa755d1e209131cea6780b | | FedRep | 76.79 | Not recorded | 68fa755d1e209131cea6780b | | Ditto | 73.29 | Not recorded | 68fa755d1e209131cea6780b | | Ditto | 72.88 | Not recorded | 68fa755d1e209131cea6780b | | FedRep | 71.49 | Not recorded | 68fa755d1e209131cea6780b | | pFedMe | 71.17 | Not recorded | 68fa755d1e209131cea6780b | | pFedMe | 70.69 | Not recorded | 68fa755d1e209131cea6780b | | IFCA | 69.45 | Not recorded | 68fa755d1e209131cea6780b | | FedPAC | 69.33 | Not recorded | 68fa755d1e209131cea6780b | | Flash | 68.96 | Not recorded | 68fa755d1e209131cea6780b | | FedProx | 68.43 | Not recorded | 68fa755d1e209131cea6780b | | FedProx | 68.16 | Not recorded | 68fa755d1e209131cea6780b | | AdapFedAvg | 68.07 | Not recorded | 68fa755d1e209131cea6780b | | FedAvg | 68 | Not recorded | 68fa755d1e209131cea6780b | | FedFM | 67.89 | Not recorded | 68fa755d1e209131cea6780b | | Flash | 67.88 | Not recorded | 68fa755d1e209131cea6780b | | FedBABU | 67.8 | Not recorded | 68fa755d1e209131cea6780b | | FedAvg | 67.39 | Not recorded | 68fa755d1e209131cea6780b | | FedFM | 67.29 | Not recorded | 68fa755d1e209131cea6780b | | AdapFedAvg | 66.91 | Not recorded | 68fa755d1e209131cea6780b | | SCAFFOLD | 66.3 | Not recorded | 68fa755d1e209131cea6780b | | SCAFFOLD | 65.98 | Not recorded | 68fa755d1e209131cea6780b | | FedDrift | 63.81 | Not recorded | 68fa755d1e209131cea6780b | ### FedCCFA Accuracy (Generalized): 87.63. Result ID: 6993ab633a6c31484917b105. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction. ### FedCCFA Accuracy (Generalized): 85.22. Result ID: 6993ab633a6c31484917b104. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction. ### IFCA Accuracy (Generalized): 82.9. Result ID: 6993ab633a6c31484917b101. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction. ### FedDrift Accuracy (Generalized): 80.48. Result ID: 6993ab633a6c31484917b103. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction. ### FedPAC Accuracy (Generalized): 79.96. Result ID: 6993ab633a6c31484917b0ff. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction. ### FedBABU Accuracy (Generalized): 76.93. Result ID: 6993ab633a6c31484917b0fd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction. ### FedRep Accuracy (Generalized): 76.79. Result ID: 6993ab633a6c31484917b0fb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction. ### Ditto Accuracy (Generalized): 73.29. Result ID: 6993ab633a6c31484917b0f9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction. ### Ditto Accuracy (Generalized): 72.88. Result ID: 6993ab633a6c31484917b0f8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction. ### FedRep Accuracy (Generalized): 71.49. Result ID: 6993ab633a6c31484917b0fa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction. ### pFedMe Accuracy (Generalized): 71.17. Result ID: 6993ab633a6c31484917b0f7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction. ### pFedMe Accuracy (Generalized): 70.69. Result ID: 6993ab633a6c31484917b0f6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction. ### IFCA Accuracy (Generalized): 69.45. Result ID: 6993ab633a6c31484917b100. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction. ### FedPAC Accuracy (Generalized): 69.33. Result ID: 6993ab633a6c31484917b0fe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction. ### Flash Accuracy (Generalized): 68.96. Result ID: 6993ab633a6c31484917b0f5. [Reporting paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction. ### FedProx Accuracy (Generalized): 68.43. Result ID: 6993ab633a6c31484917b0ec. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction. ### FedProx Accuracy (Generalized): 68.16. Result ID: 6993ab633a6c31484917b0ed. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction. ### AdapFedAvg Accuracy (Generalized): 68.07. Result ID: 6993ab633a6c31484917b0f3. [Reporting paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction. ### FedAvg Accuracy (Generalized): 68. Result ID: 6993ab633a6c31484917b0eb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction. ### FedFM Accuracy (Generalized): 67.89. Result ID: 6993ab633a6c31484917b0f0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction. ### Flash Accuracy (Generalized): 67.88. Result ID: 6993ab633a6c31484917b0f4. [Reporting paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction. ### FedBABU Accuracy (Generalized): 67.8. Result ID: 6993ab633a6c31484917b0fc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction. ### FedAvg Accuracy (Generalized): 67.39. Result ID: 6993ab633a6c31484917b0ea. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction. ### FedFM Accuracy (Generalized): 67.29. Result ID: 6993ab633a6c31484917b0f1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction. ### AdapFedAvg Accuracy (Generalized): 66.91. Result ID: 6993ab633a6c31484917b0f2. [Reporting paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction. ### SCAFFOLD Accuracy (Generalized): 66.3. Result ID: 6993ab633a6c31484917b0ef. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction. ### SCAFFOLD Accuracy (Generalized): 65.98. Result ID: 6993ab633a6c31484917b0ee. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction. ### FedDrift Accuracy (Generalized): 63.81. Result ID: 6993ab633a6c31484917b102. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.