# Image Classification on MNIST pair noise 0.4 Dirichlet non-IID (a=100) (test) Source: [Image Classification on MNIST pair noise 0.4 Dirichlet non-IID (a=100) (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:41:20.659Z Evaluation of Image Classification performance on the test split of the MNIST dataset corrupted by 40% pair noise generated using a Dirichlet distribution with parameter a=100 (non-IID). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Image Classification | | Dataset (including any stated split) | MNIST pair noise 0.4 Dirichlet non-IID (a=100) (test) | | Metric | ECE | | Unit | SCALAR | | Direction | Lower is better | | Results loaded | 11 of 11 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [ECE](): Lower is better; unit: SCALAR. - [MCE](): Lower is better; unit: SCALAR. - [Top-1 Acc](): Higher is better; unit: PERCENT. ## Recorded results | Method | ECE | Result date | Report paper | | --- | --- | --- | --- | | SuPerFed-MM | 0.28 | Not recorded | 68fa6d301e209131cea383bb | | SuPerFed-LM | 0.35 | Not recorded | 68fa6d301e209131cea383bb | | FedAvg | 0.38 | Not recorded | 68fa6d301e209131cea383bb | | FedProx | 0.38 | Not recorded | 68fa6d301e209131cea383bb | | FedPer | 0.4 | Not recorded | 68fa6d301e209131cea383bb | | LG-FedAvg | 0.42 | Not recorded | 68fa6d301e209131cea383bb | | APFL | 0.42 | Not recorded | 68fa6d301e209131cea383bb | | Ditto | 0.42 | Not recorded | 68fa6d301e209131cea383bb | | FedRep | 0.43 | Not recorded | 68fa6d301e209131cea383bb | | SCAFFOLD | 0.45 | Not recorded | 68fa6d301e209131cea383bb | | pFedMe | 0.46 | Not recorded | 68fa6d301e209131cea383bb | ### SuPerFed-MM ECE: 0.28. Result ID: 698f96473a6c314849fa518b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Dirichlet alpha":"100"}. This record does not assert independent reproduction. ### SuPerFed-LM ECE: 0.35. Result ID: 698f96473a6c314849fa518c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Dirichlet alpha":"100"}. This record does not assert independent reproduction. ### FedAvg ECE: 0.38. Result ID: 698f96473a6c314849fa5182. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Dirichlet alpha":"100"}. This record does not assert independent reproduction. ### FedProx ECE: 0.38. Result ID: 698f96473a6c314849fa5183. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Dirichlet alpha":"100"}. This record does not assert independent reproduction. ### FedPer ECE: 0.4. Result ID: 698f96473a6c314849fa5186. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Dirichlet alpha":"100"}. This record does not assert independent reproduction. ### LG-FedAvg ECE: 0.42. Result ID: 698f96473a6c314849fa5185. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Dirichlet alpha":"100"}. This record does not assert independent reproduction. ### APFL ECE: 0.42. Result ID: 698f96473a6c314849fa5187. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Dirichlet alpha":"100"}. This record does not assert independent reproduction. ### Ditto ECE: 0.42. Result ID: 698f96473a6c314849fa5189. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Dirichlet alpha":"100"}. This record does not assert independent reproduction. ### FedRep ECE: 0.43. Result ID: 698f96473a6c314849fa518a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Dirichlet alpha":"100"}. This record does not assert independent reproduction. ### SCAFFOLD ECE: 0.45. Result ID: 698f96473a6c314849fa5184. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Dirichlet alpha":"100"}. This record does not assert independent reproduction. ### pFedMe ECE: 0.46. Result ID: 698f96473a6c314849fa5188. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Dirichlet alpha":"100"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.