# Image Classification on CINIC-10 under sudden drift and Dir(0.1) 1.0 (test)

Source: [Image Classification on CINIC-10 under sudden drift and Dir(0.1) 1.0 (test)](<https://www.sota2.com/research/sota/image-classification-on-cinic-10-under-sudden-drift-and-dir-0-1-1-0-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:45:56.879Z

Evaluation of Image Classification performance on the CINIC-10 dataset subjected to sudden distribution drift under the Dir(0.1) configuration at time step 1.0, using the test set.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Image Classification |
| Dataset (including any stated split) | CINIC-10 under sudden drift and Dir(0.1) 1.0 (test) |
| Metric | Generalized Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 27 of 27 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Generalized Accuracy](<https://www.sota2.com/research/sota/image-classification-on-cinic-10-under-sudden-drift-and-dir-0-1-1-0-test.md?metric=Generalized%20Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Generalized Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| FedCCFA | 46.02 | Not recorded | 68fa755d1e209131cea6780b |
| AdapFedAvg | 42.43 | Not recorded | 68fa755d1e209131cea6780b |
| FedProx | 42.27 | Not recorded | 68fa755d1e209131cea6780b |
| FedAvg | 42.15 | Not recorded | 68fa755d1e209131cea6780b |
| Flash | 41.4 | Not recorded | 68fa755d1e209131cea6780b |
| Flash | 41.35 | Not recorded | 68fa755d1e209131cea6780b |
| FedCCFA | 40.94 | Not recorded | 68fa755d1e209131cea6780b |
| Ditto | 40.22 | Not recorded | 68fa755d1e209131cea6780b |
| Ditto | 39.6 | Not recorded | 68fa755d1e209131cea6780b |
| FedProx | 38.58 | Not recorded | 68fa755d1e209131cea6780b |
| FedAvg | 37.5 | Not recorded | 68fa755d1e209131cea6780b |
| AdapFedAvg | 36.98 | Not recorded | 68fa755d1e209131cea6780b |
| FedFM | 36.84 | Not recorded | 68fa755d1e209131cea6780b |
| pFedMe | 34.54 | Not recorded | 68fa755d1e209131cea6780b |
| SCAFFOLD | 34.25 | Not recorded | 68fa755d1e209131cea6780b |
| IFCA | 33.84 | Not recorded | 68fa755d1e209131cea6780b |
| FedDrift | 32.4 | Not recorded | 68fa755d1e209131cea6780b |
| IFCA | 31.7 | Not recorded | 68fa755d1e209131cea6780b |
| FedPAC | 31.6 | Not recorded | 68fa755d1e209131cea6780b |
| FedRep | 31.17 | Not recorded | 68fa755d1e209131cea6780b |
| FedBABU | 30.97 | Not recorded | 68fa755d1e209131cea6780b |
| pFedMe | 30.77 | Not recorded | 68fa755d1e209131cea6780b |
| FedDrift | 28.32 | Not recorded | 68fa755d1e209131cea6780b |
| FedRep | 28.27 | Not recorded | 68fa755d1e209131cea6780b |
| SCAFFOLD | 27.78 | Not recorded | 68fa755d1e209131cea6780b |
| FedBABU | 25.8 | Not recorded | 68fa755d1e209131cea6780b |
| FedFM | 10 | Not recorded | 68fa755d1e209131cea6780b |

### FedCCFA

Generalized Accuracy: 46.02. Result ID: 6993ab633a6c31484917b13c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Implementation](<https://github.com/Chen-Junbao/FedCCFA>)

Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction.

### AdapFedAvg

Generalized Accuracy: 42.43. Result ID: 6993ab633a6c31484917b12a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction.

### FedProx

Generalized Accuracy: 42.27. Result ID: 6993ab633a6c31484917b124.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67701e209131cea163fe.md>)

Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction.

### FedAvg

Generalized Accuracy: 42.15. Result ID: 6993ab633a6c31484917b122.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e761e209131cea40072.md>)

Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction.

### Flash

Generalized Accuracy: 41.4. Result ID: 6993ab633a6c31484917b12d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction.

### Flash

Generalized Accuracy: 41.35. Result ID: 6993ab633a6c31484917b12c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction.

### FedCCFA

Generalized Accuracy: 40.94. Result ID: 6993ab633a6c31484917b13b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Implementation](<https://github.com/Chen-Junbao/FedCCFA>)

Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction.

### Ditto

Generalized Accuracy: 40.22. Result ID: 6993ab633a6c31484917b131.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a2d1e209131cea269df.md>)

Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction.

### Ditto

Generalized Accuracy: 39.6. Result ID: 6993ab633a6c31484917b130.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a2d1e209131cea269df.md>)

Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction.

### FedProx

Generalized Accuracy: 38.58. Result ID: 6993ab633a6c31484917b125.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67701e209131cea163fe.md>)

Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction.

### FedAvg

Generalized Accuracy: 37.5. Result ID: 6993ab633a6c31484917b123.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e761e209131cea40072.md>)

Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction.

### AdapFedAvg

Generalized Accuracy: 36.98. Result ID: 6993ab633a6c31484917b12b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction.

### FedFM

Generalized Accuracy: 36.84. Result ID: 6993ab633a6c31484917b129.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6daa1e209131cea3b4d8.md>)

Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction.

### pFedMe

Generalized Accuracy: 34.54. Result ID: 6993ab633a6c31484917b12f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ba21e209131cea2f6fd.md>)

Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction.

### SCAFFOLD

Generalized Accuracy: 34.25. Result ID: 6993ab633a6c31484917b127.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa57fa1e209131ce9aa47a.md>)

Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction.

### IFCA

Generalized Accuracy: 33.84. Result ID: 6993ab633a6c31484917b137.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a1d1e209131cea25f96.md>)

Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction.

### FedDrift

Generalized Accuracy: 32.4. Result ID: 6993ab633a6c31484917b13a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eaf1e209131cea416c3.md>)

Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction.

### IFCA

Generalized Accuracy: 31.7. Result ID: 6993ab633a6c31484917b138.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a1d1e209131cea25f96.md>)

Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction.

### FedPAC

Generalized Accuracy: 31.6. Result ID: 6993ab633a6c31484917b136.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fc81e209131cea4759f.md>)

Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction.

### FedRep

Generalized Accuracy: 31.17. Result ID: 6993ab633a6c31484917b133.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5a3d1e209131ce9be169.md>)

Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction.

### FedBABU

Generalized Accuracy: 30.97. Result ID: 6993ab633a6c31484917b135.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bfa1e209131cea31630.md>)

Recorded evaluation configuration: {"Number of clients":100,"Sample ratio":"20%"}. This record does not assert independent reproduction.

### pFedMe

Generalized Accuracy: 30.77. Result ID: 6993ab633a6c31484917b12e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ba21e209131cea2f6fd.md>)

Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction.

### FedDrift

Generalized Accuracy: 28.32. Result ID: 6993ab633a6c31484917b139.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eaf1e209131cea416c3.md>)

Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction.

### FedRep

Generalized Accuracy: 28.27. Result ID: 6993ab633a6c31484917b132.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5a3d1e209131ce9be169.md>)

Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction.

### SCAFFOLD

Generalized Accuracy: 27.78. Result ID: 6993ab633a6c31484917b126.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa57fa1e209131ce9aa47a.md>)

Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction.

### FedBABU

Generalized Accuracy: 25.8. Result ID: 6993ab633a6c31484917b134.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bfa1e209131cea31630.md>)

Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction.

### FedFM

Generalized Accuracy: 10. Result ID: 6993ab633a6c31484917b128.

[Reporting paper](<https://www.sota2.com/research/paper/68fa755d1e209131cea6780b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6daa1e209131cea3b4d8.md>)

Recorded evaluation configuration: {"Number of clients":20,"Sample ratio":"100%"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
