# Image Classification on MNIST 100 clients, highly heterog. (test) Source: [Image Classification on MNIST 100 clients, highly heterog. (test)]() Collection index: [llms.txt]() Data updated: 2026-03-04T17:57:59.052Z Evaluation of Image Classification performance on the test split of the MNIST dataset configured for a highly heterogeneous setting across 100 distributed clients. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Image Classification | | Dataset (including any stated split) | MNIST 100 clients, highly heterog. (test) | | Metric | Test Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Test Accuracy](): Higher is better; unit: PERCENT. - [Test NLL](): Lower is better; unit: SCALAR. ## Recorded results | Method | Test Accuracy | Result date | Report paper | | --- | --- | --- | --- | | IVON-ADMM@mg | 96 | Not recorded | 68fa5da71e209131ce9dbecb | | IVON-ADMM | 96 | Not recorded | 68fa5da71e209131ce9dbecb | | FedDyn | 94.9 | Not recorded | 68fa5da71e209131ce9dbecb | | FedLap-Cov | 94.9 | Not recorded | 68fa5da71e209131ce9dbecb | | FedLap | 94.4 | Not recorded | 68fa5da71e209131ce9dbecb | | IVON-ADMM@mg | 94.2 | Not recorded | 68fa5da71e209131ce9dbecb | | IVON-ADMM | 94.2 | Not recorded | 68fa5da71e209131ce9dbecb | | FedAvg/FedProx | 94 | Not recorded | 68fa5da71e209131ce9dbecb | | FedLap-Cov | 92.9 | Not recorded | 68fa5da71e209131ce9dbecb | | FedDyn | 92.6 | Not recorded | 68fa5da71e209131ce9dbecb | | FedLap | 92 | Not recorded | 68fa5da71e209131ce9dbecb | | FedAvg/FedProx | 91.8 | Not recorded | 68fa5da71e209131ce9dbecb | | FedLap-Cov | 91 | Not recorded | 68fa5da71e209131ce9dbecb | | IVON-ADMM@mg | 91 | Not recorded | 68fa5da71e209131ce9dbecb | | IVON-ADMM | 91 | Not recorded | 68fa5da71e209131ce9dbecb | | FedDyn | 89.8 | Not recorded | 68fa5da71e209131ce9dbecb | | FedLap | 89.7 | Not recorded | 68fa5da71e209131ce9dbecb | | FedAvg/FedProx | 89.6 | Not recorded | 68fa5da71e209131ce9dbecb | ### IVON-ADMM@mg Test Accuracy: 96. Result ID: 69a872946dbb7075b950702e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MLP","Communication rounds":"100"}. This record does not assert independent reproduction. ### IVON-ADMM Test Accuracy: 96. Result ID: 69a872946dbb7075b9507031. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MLP","Communication rounds":"100"}. This record does not assert independent reproduction. ### FedDyn Test Accuracy: 94.9. Result ID: 69a872946dbb7075b9507025. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MLP","Communication rounds":"100"}. This record does not assert independent reproduction. ### FedLap-Cov Test Accuracy: 94.9. Result ID: 69a872946dbb7075b950702b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MLP","Communication rounds":"100"}. This record does not assert independent reproduction. ### FedLap Test Accuracy: 94.4. Result ID: 69a872946dbb7075b9507028. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MLP","Communication rounds":"100"}. This record does not assert independent reproduction. ### IVON-ADMM@mg Test Accuracy: 94.2. Result ID: 69a872946dbb7075b950702d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MLP","Communication rounds":"50"}. This record does not assert independent reproduction. ### IVON-ADMM Test Accuracy: 94.2. Result ID: 69a872946dbb7075b9507030. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MLP","Communication rounds":"50"}. This record does not assert independent reproduction. ### FedAvg/FedProx Test Accuracy: 94. Result ID: 69a872946dbb7075b9507022. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MLP","Communication rounds":"100"}. This record does not assert independent reproduction. ### FedLap-Cov Test Accuracy: 92.9. Result ID: 69a872946dbb7075b950702a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MLP","Communication rounds":"50"}. This record does not assert independent reproduction. ### FedDyn Test Accuracy: 92.6. Result ID: 69a872946dbb7075b9507024. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MLP","Communication rounds":"50"}. This record does not assert independent reproduction. ### FedLap Test Accuracy: 92. Result ID: 69a872946dbb7075b9507027. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MLP","Communication rounds":"50"}. This record does not assert independent reproduction. ### FedAvg/FedProx Test Accuracy: 91.8. Result ID: 69a872946dbb7075b9507021. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MLP","Communication rounds":"50"}. This record does not assert independent reproduction. ### FedLap-Cov Test Accuracy: 91. Result ID: 69a872946dbb7075b9507029. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MLP","Communication rounds":"25"}. This record does not assert independent reproduction. ### IVON-ADMM@mg Test Accuracy: 91. Result ID: 69a872946dbb7075b950702c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MLP","Communication rounds":"25"}. This record does not assert independent reproduction. ### IVON-ADMM Test Accuracy: 91. Result ID: 69a872946dbb7075b950702f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MLP","Communication rounds":"25"}. This record does not assert independent reproduction. ### FedDyn Test Accuracy: 89.8. Result ID: 69a872946dbb7075b9507023. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MLP","Communication rounds":"25"}. This record does not assert independent reproduction. ### FedLap Test Accuracy: 89.7. Result ID: 69a872946dbb7075b9507026. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MLP","Communication rounds":"25"}. This record does not assert independent reproduction. ### FedAvg/FedProx Test Accuracy: 89.6. Result ID: 69a872946dbb7075b9507020. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"MLP","Communication rounds":"25"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.