# Image Classification on MNIST (Shards) Source: [Image Classification on MNIST (Shards)]() Collection index: [llms.txt]() Data updated: 2026-05-21T13:15:38.068Z Evaluation of Image Classification models on the MNIST dataset configured with Shards, reporting performance metrics RES, PQS, CES, and UES. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Image Classification | | Dataset (including any stated split) | MNIST (Shards) | | Metric | RES | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 14 of 14 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [RES](): Higher is better; unit: SCALAR. - [PQS](): Higher is better; unit: SCALAR. - [CES](): Lower is better; unit: SCALAR. - [UES](): Higher is better; unit: SCALAR. ## Recorded results | Method | RES | Result date | Report paper | | --- | --- | --- | --- | | Local-KD | 1 | Not recorded | 6a0e91c1f984739ed6738d79 | | FedMD | 0.9727 | Not recorded | 6a0e91c1f984739ed6738d79 | | Local-KD | 0.9423 | Not recorded | 6a0e91c1f984739ed6738d79 | | FedKD-NAS | 0.9396 | Not recorded | 6a0e91c1f984739ed6738d79 | | FedDF | 0.8751 | Not recorded | 6a0e91c1f984739ed6738d79 | | FedKD-NAS | 0.8733 | Not recorded | 6a0e91c1f984739ed6738d79 | | Ditto | 0.8676 | Not recorded | 6a0e91c1f984739ed6738d79 | | FedDF | 0.8622 | Not recorded | 6a0e91c1f984739ed6738d79 | | Ditto | 0.8562 | Not recorded | 6a0e91c1f984739ed6738d79 | | FedAvg | 0.8543 | Not recorded | 6a0e91c1f984739ed6738d79 | | FedAvg | 0.8489 | Not recorded | 6a0e91c1f984739ed6738d79 | | FedMD | 0.8305 | Not recorded | 6a0e91c1f984739ed6738d79 | | FedDistill | 0.8241 | Not recorded | 6a0e91c1f984739ed6738d79 | | FedDistill | 0.8164 | Not recorded | 6a0e91c1f984739ed6738d79 | ### Local-KD RES: 1. Result ID: 6a0f0461fbc373592c07c6b2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LeNet5"}. This record does not assert independent reproduction. ### FedMD RES: 0.9727. Result ID: 6a0f0461fbc373592c07c6b8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"ResNet18"}. This record does not assert independent reproduction. ### Local-KD RES: 0.9423. Result ID: 6a0f0461fbc373592c07c6b9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"ResNet18"}. This record does not assert independent reproduction. ### FedKD-NAS RES: 0.9396. Result ID: 6a0f0461fbc373592c07c6b3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LeNet5"}. This record does not assert independent reproduction. ### FedDF RES: 0.8751. Result ID: 6a0f0461fbc373592c07c6b6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"ResNet18"}. This record does not assert independent reproduction. ### FedKD-NAS RES: 0.8733. Result ID: 6a0f0461fbc373592c07c6ba. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"ResNet18"}. This record does not assert independent reproduction. ### Ditto RES: 0.8676. Result ID: 6a0f0461fbc373592c07c6ae. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LeNet5"}. This record does not assert independent reproduction. ### FedDF RES: 0.8622. Result ID: 6a0f0461fbc373592c07c6af. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LeNet5"}. This record does not assert independent reproduction. ### Ditto RES: 0.8562. Result ID: 6a0f0461fbc373592c07c6b5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"ResNet18"}. This record does not assert independent reproduction. ### FedAvg RES: 0.8543. Result ID: 6a0f0461fbc373592c07c6ad. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LeNet5"}. This record does not assert independent reproduction. ### FedAvg RES: 0.8489. Result ID: 6a0f0461fbc373592c07c6b4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"ResNet18"}. This record does not assert independent reproduction. ### FedMD RES: 0.8305. Result ID: 6a0f0461fbc373592c07c6b1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LeNet5"}. This record does not assert independent reproduction. ### FedDistill RES: 0.8241. Result ID: 6a0f0461fbc373592c07c6b7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"ResNet18"}. This record does not assert independent reproduction. ### FedDistill RES: 0.8164. Result ID: 6a0f0461fbc373592c07c6b0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LeNet5"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.