# Image Classification on CIFAR-10 (test) (Accuracy Variance Metrics) Source: [Image Classification on CIFAR-10 (test) (Accuracy Variance Metrics)]() Collection index: [llms.txt]() Data updated: 2026-05-21T13:07:26.245Z Evaluation of Image Classification model performance on the CIFAR-10 test set, focusing on the mean accuracy and the variance across different subsets of the data (Best 10% and Worst 10% accuracy). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Image Classification | | Dataset (including any stated split) | CIFAR-10 (test) | | Metric | Mean Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 14 of 14 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Mean Accuracy](): Higher is better; unit: PERCENT. - [Best 10% Accuracy](): Higher is better; unit: PERCENT. - [Worst 10% Accuracy](): Higher is better; unit: PERCENT. - [Standard Deviation](): Lower is better; unit: SCALAR. ## Recorded results | Method | Mean Accuracy | Result date | Report paper | | --- | --- | --- | --- | | CRAFT | 80.6 | Not recorded | 6a0e91c1f984739ed6738d74 | | ConFIG | 52.5 | Not recorded | 6a0e91c1f984739ed6738d74 | | FedLF | 50.1 | Not recorded | 6a0e91c1f984739ed6738d74 | | FedAvgM | 46.3 | Not recorded | 6a0e91c1f984739ed6738d74 | | FedAdaGrad | 42.7 | Not recorded | 6a0e91c1f984739ed6738d74 | | FedFV | 42.1 | Not recorded | 6a0e91c1f984739ed6738d74 | | FedAdam | 41.2 | Not recorded | 6a0e91c1f984739ed6738d74 | | FedYogi | 39.8 | Not recorded | 6a0e91c1f984739ed6738d74 | | FedNova | 38.1 | Not recorded | 6a0e91c1f984739ed6738d74 | | FedAvg | 35.6 | Not recorded | 6a0e91c1f984739ed6738d74 | | FedProx | 35.6 | Not recorded | 6a0e91c1f984739ed6738d74 | | qFedAvg | 35.2 | Not recorded | 6a0e91c1f984739ed6738d74 | | AFL | 29.4 | Not recorded | 6a0e91c1f984739ed6738d74 | | FedMGDA+ | 23.5 | Not recorded | 6a0e91c1f984739ed6738d74 | ### CRAFT Mean Accuracy: 80.6. Result ID: 6a0f0370fbc373592c07c12a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"ResNet-20"}. This record does not assert independent reproduction. ### ConFIG Mean Accuracy: 52.5. Result ID: 6a0f0370fbc373592c07c129. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"ResNet-20"}. This record does not assert independent reproduction. ### FedLF Mean Accuracy: 50.1. Result ID: 6a0f0370fbc373592c07c128. [Reporting paper]() Recorded evaluation configuration: {"Architecture":"ResNet-20"}. This record does not assert independent reproduction. ### FedAvgM Mean Accuracy: 46.3. Result ID: 6a0f0370fbc373592c07c120. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"ResNet-20"}. This record does not assert independent reproduction. ### FedAdaGrad Mean Accuracy: 42.7. Result ID: 6a0f0370fbc373592c07c121. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"ResNet-20"}. This record does not assert independent reproduction. ### FedFV Mean Accuracy: 42.1. Result ID: 6a0f0370fbc373592c07c125. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"ResNet-20"}. This record does not assert independent reproduction. ### FedAdam Mean Accuracy: 41.2. Result ID: 6a0f0370fbc373592c07c122. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"ResNet-20"}. This record does not assert independent reproduction. ### FedYogi Mean Accuracy: 39.8. Result ID: 6a0f0370fbc373592c07c123. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"ResNet-20"}. This record does not assert independent reproduction. ### FedNova Mean Accuracy: 38.1. Result ID: 6a0f0370fbc373592c07c11f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"ResNet-20"}. This record does not assert independent reproduction. ### FedAvg Mean Accuracy: 35.6. Result ID: 6a0f0370fbc373592c07c11d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"ResNet-20"}. This record does not assert independent reproduction. ### FedProx Mean Accuracy: 35.6. Result ID: 6a0f0370fbc373592c07c11e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"ResNet-20"}. This record does not assert independent reproduction. ### qFedAvg Mean Accuracy: 35.2. Result ID: 6a0f0370fbc373592c07c127. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"ResNet-20"}. This record does not assert independent reproduction. ### AFL Mean Accuracy: 29.4. Result ID: 6a0f0370fbc373592c07c124. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"ResNet-20"}. This record does not assert independent reproduction. ### FedMGDA+ Mean Accuracy: 23.5. Result ID: 6a0f0370fbc373592c07c126. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"ResNet-20"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.