# Multi-class classification on TinyImageNet Dirichlet non-IID setting (test) Source: [Multi-class classification on TinyImageNet Dirichlet non-IID setting (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:07:22.497Z Evaluation of Multi-class classification performance on the test split of TinyImageNet when data is sampled under a general Dirichlet non-IID setting. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Multi-class classification | | Dataset (including any stated split) | TinyImageNet Dirichlet non-IID setting (test) | | Metric | Top-5 Acc | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 33 of 33 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Top-5 Acc](): Higher is better; unit: PERCENT. ## Recorded results | Method | Top-5 Acc | Result date | Report paper | | --- | --- | --- | --- | | SuPerFed-LM | 52.9 | Not recorded | 68fa6d301e209131cea383bb | | SuPerFed-MM | 50.07 | Not recorded | 68fa6d301e209131cea383bb | | SuPerFed-MM | 49.86 | Not recorded | 68fa6d301e209131cea383bb | | SuPerFed-MM | 49.73 | Not recorded | 68fa6d301e209131cea383bb | | SuPerFed-LM | 49.29 | Not recorded | 68fa6d301e209131cea383bb | | SuPerFed-LM | 48.98 | Not recorded | 68fa6d301e209131cea383bb | | FedProx | 48.97 | Not recorded | 68fa6d301e209131cea383bb | | FedAvg | 48.9 | Not recorded | 68fa6d301e209131cea383bb | | FedAvg | 48.9 | Not recorded | 68fa6d301e209131cea383bb | | SCAFFOLD | 48.77 | Not recorded | 68fa6d301e209131cea383bb | | SCAFFOLD | 48.27 | Not recorded | 68fa6d301e209131cea383bb | | FedProx | 47.73 | Not recorded | 68fa6d301e209131cea383bb | | FedProx | 47.37 | Not recorded | 68fa6d301e209131cea383bb | | FedAvg | 46.61 | Not recorded | 68fa6d301e209131cea383bb | | SCAFFOLD | 46.54 | Not recorded | 68fa6d301e209131cea383bb | | APFL | 46.36 | Not recorded | 68fa6d301e209131cea383bb | | Ditto | 43.84 | Not recorded | 68fa6d301e209131cea383bb | | Ditto | 43.11 | Not recorded | 68fa6d301e209131cea383bb | | Ditto | 41.98 | Not recorded | 68fa6d301e209131cea383bb | | APFL | 34.74 | Not recorded | 68fa6d301e209131cea383bb | | APFL | 34.23 | Not recorded | 68fa6d301e209131cea383bb | | FedPer | 21.9 | Not recorded | 68fa6d301e209131cea383bb | | FedRep | 18.67 | Not recorded | 68fa6d301e209131cea383bb | | LG-FedAvg | 14.7 | Not recorded | 68fa6d301e209131cea383bb | | FedPer | 11.1 | Not recorded | 68fa6d301e209131cea383bb | | LG-FedAvg | 9.86 | Not recorded | 68fa6d301e209131cea383bb | | FedPer | 9.63 | Not recorded | 68fa6d301e209131cea383bb | | LG-FedAvg | 9.25 | Not recorded | 68fa6d301e209131cea383bb | | FedRep | 9.23 | Not recorded | 68fa6d301e209131cea383bb | | FedRep | 8.09 | Not recorded | 68fa6d301e209131cea383bb | | pFedMe | 8.01 | Not recorded | 68fa6d301e209131cea383bb | | pFedMe | 7.69 | Not recorded | 68fa6d301e209131cea383bb | | pFedMe | 6.05 | Not recorded | 68fa6d301e209131cea383bb | ### SuPerFed-LM Top-5 Acc: 52.9. Result ID: 698f96473a6c314849fa5266. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":1,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### SuPerFed-MM Top-5 Acc: 50.07. Result ID: 698f96473a6c314849fa5263. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":1,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### SuPerFed-MM Top-5 Acc: 49.86. Result ID: 698f96473a6c314849fa5264. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":10,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### SuPerFed-MM Top-5 Acc: 49.73. Result ID: 698f96473a6c314849fa5265. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":100,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### SuPerFed-LM Top-5 Acc: 49.29. Result ID: 698f96473a6c314849fa5268. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":100,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### SuPerFed-LM Top-5 Acc: 48.98. Result ID: 698f96473a6c314849fa5267. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":10,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### FedProx Top-5 Acc: 48.97. Result ID: 698f96473a6c314849fa524d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":100,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### FedAvg Top-5 Acc: 48.9. Result ID: 698f96473a6c314849fa5249. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":10,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### FedAvg Top-5 Acc: 48.9. Result ID: 698f96473a6c314849fa524a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":100,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### SCAFFOLD Top-5 Acc: 48.77. Result ID: 698f96473a6c314849fa524f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":10,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### SCAFFOLD Top-5 Acc: 48.27. Result ID: 698f96473a6c314849fa5250. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":100,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### FedProx Top-5 Acc: 47.73. Result ID: 698f96473a6c314849fa524c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":10,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### FedProx Top-5 Acc: 47.37. Result ID: 698f96473a6c314849fa524b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":1,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### FedAvg Top-5 Acc: 46.61. Result ID: 698f96473a6c314849fa5248. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":1,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### SCAFFOLD Top-5 Acc: 46.54. Result ID: 698f96473a6c314849fa524e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":1,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### APFL Top-5 Acc: 46.36. Result ID: 698f96473a6c314849fa5257. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":1,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### Ditto Top-5 Acc: 43.84. Result ID: 698f96473a6c314849fa525e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":10,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### Ditto Top-5 Acc: 43.11. Result ID: 698f96473a6c314849fa525f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":100,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### Ditto Top-5 Acc: 41.98. Result ID: 698f96473a6c314849fa525d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":1,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### APFL Top-5 Acc: 34.74. Result ID: 698f96473a6c314849fa5258. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":10,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### APFL Top-5 Acc: 34.23. Result ID: 698f96473a6c314849fa5259. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":100,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### FedPer Top-5 Acc: 21.9. Result ID: 698f96473a6c314849fa5254. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":1,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### FedRep Top-5 Acc: 18.67. Result ID: 698f96473a6c314849fa5260. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":1,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### LG-FedAvg Top-5 Acc: 14.7. Result ID: 698f96473a6c314849fa5251. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":1,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### FedPer Top-5 Acc: 11.1. Result ID: 698f96473a6c314849fa5255. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":10,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### LG-FedAvg Top-5 Acc: 9.86. Result ID: 698f96473a6c314849fa5252. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":10,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### FedPer Top-5 Acc: 9.63. Result ID: 698f96473a6c314849fa5256. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":100,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### LG-FedAvg Top-5 Acc: 9.25. Result ID: 698f96473a6c314849fa5253. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":100,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### FedRep Top-5 Acc: 9.23. Result ID: 698f96473a6c314849fa5261. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":10,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### FedRep Top-5 Acc: 8.09. Result ID: 698f96473a6c314849fa5262. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":100,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### pFedMe Top-5 Acc: 8.01. Result ID: 698f96473a6c314849fa525b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":10,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### pFedMe Top-5 Acc: 7.69. Result ID: 698f96473a6c314849fa525c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":100,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. ### pFedMe Top-5 Acc: 6.05. Result ID: 698f96473a6c314849fa525a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"concentration (alpha)":1,"# clients":200,"Backbone":"MobileNet"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.