# Federated Learning Classification on EMNIST dir(alpha=0.1) (test)

Source: [Federated Learning Classification on EMNIST dir(alpha=0.1) (test)](<https://www.sota2.com/research/sota/federated-learning-classification-on-emnist-dir-alpha-0-1-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-01T08:45:29.522Z

Evaluation of Federated Learning Classification performance on the EMNIST dataset configured with a Dirichlet distribution shift (alpha=0.1) applied to the test split.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Federated Learning Classification |
| Dataset (including any stated split) | EMNIST dir(alpha=0.1) (test) |
| Metric | Max r\_k(theta) |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Max r\_k(theta)](<https://www.sota2.com/research/sota/federated-learning-classification-on-emnist-dir-alpha-0-1-test.md?metric=Max%20r_k(theta)>): Lower is better; unit: SCALAR.

- [Min r\_k(theta)](<https://www.sota2.com/research/sota/federated-learning-classification-on-emnist-dir-alpha-0-1-test.md?metric=Min%20r_k(theta)>): Higher is better; unit: SCALAR.

- [Accuracy](<https://www.sota2.com/research/sota/federated-learning-classification-on-emnist-dir-alpha-0-1-test.md?metric=Accuracy>): Higher is better; unit: PERCENT.

- [Variance r\_k(theta)](<https://www.sota2.com/research/sota/federated-learning-classification-on-emnist-dir-alpha-0-1-test.md?metric=Variance%20r_k(theta)>): Lower is better; unit: SCALAR.

## Recorded results

| Method | Max r\_k(theta) | Result date | Report paper |
| --- | --- | --- | --- |
| EAGLE | 0.063 | Not recorded | 69cca6a20636e5bf4afcbc4a |
| EAGLE | 0.091 | Not recorded | 69cca6a20636e5bf4afcbc4a |
| q-FFL | 0.097 | Not recorded | 69cca6a20636e5bf4afcbc4a |
| AFL | 0.144 | Not recorded | 69cca6a20636e5bf4afcbc4a |
| EAGLE | 0.153 | Not recorded | 69cca6a20636e5bf4afcbc4a |
| EAGLE | 0.178 | Not recorded | 69cca6a20636e5bf4afcbc4a |
| EAGLE | 0.192 | Not recorded | 69cca6a20636e5bf4afcbc4a |
| q-FFL | 0.244 | Not recorded | 69cca6a20636e5bf4afcbc4a |
| FedAvg | 0.294 | Not recorded | 69cca6a20636e5bf4afcbc4a |
| q-FFL | 0.386 | Not recorded | 69cca6a20636e5bf4afcbc4a |

### EAGLE

Max r\_k(theta): 0.063. Result ID: 69ccdb1647f34ce924b6a07c.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6a20636e5bf4afcbc4a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cca6a20636e5bf4afcbc4a.md>)

Recorded evaluation configuration: {"lambda":"1.0","Backbone":"CNN"}. This record does not assert independent reproduction.

### EAGLE

Max r\_k(theta): 0.091. Result ID: 69ccdb1647f34ce924b6a07b.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6a20636e5bf4afcbc4a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cca6a20636e5bf4afcbc4a.md>)

Recorded evaluation configuration: {"lambda":"0.1","Backbone":"CNN"}. This record does not assert independent reproduction.

### q-FFL

Max r\_k(theta): 0.097. Result ID: 69ccdb1647f34ce924b6a078.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6a20636e5bf4afcbc4a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67041e209131cea13c79.md>)

Recorded evaluation configuration: {"q":"1.0","Backbone":"CNN"}. This record does not assert independent reproduction.

### AFL

Max r\_k(theta): 0.144. Result ID: 69ccdb1647f34ce924b6a076.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6a20636e5bf4afcbc4a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65541e209131cea09bec.md>)

Recorded evaluation configuration: {"Backbone":"CNN"}. This record does not assert independent reproduction.

### EAGLE

Max r\_k(theta): 0.153. Result ID: 69ccdb1647f34ce924b6a07e.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6a20636e5bf4afcbc4a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cca6a20636e5bf4afcbc4a.md>)

Recorded evaluation configuration: {"lambda":"3.0","Backbone":"CNN"}. This record does not assert independent reproduction.

### EAGLE

Max r\_k(theta): 0.178. Result ID: 69ccdb1647f34ce924b6a07d.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6a20636e5bf4afcbc4a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cca6a20636e5bf4afcbc4a.md>)

Recorded evaluation configuration: {"lambda":"2.0","Backbone":"CNN"}. This record does not assert independent reproduction.

### EAGLE

Max r\_k(theta): 0.192. Result ID: 69ccdb1647f34ce924b6a07f.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6a20636e5bf4afcbc4a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cca6a20636e5bf4afcbc4a.md>)

Recorded evaluation configuration: {"lambda":"5.0","Backbone":"CNN"}. This record does not assert independent reproduction.

### q-FFL

Max r\_k(theta): 0.244. Result ID: 69ccdb1647f34ce924b6a079.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6a20636e5bf4afcbc4a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67041e209131cea13c79.md>)

Recorded evaluation configuration: {"q":"3.0","Backbone":"CNN"}. This record does not assert independent reproduction.

### FedAvg

Max r\_k(theta): 0.294. Result ID: 69ccdb1647f34ce924b6a077.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6a20636e5bf4afcbc4a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e761e209131cea40072.md>)

Recorded evaluation configuration: {"Backbone":"CNN"}. This record does not assert independent reproduction.

### q-FFL

Max r\_k(theta): 0.386. Result ID: 69ccdb1647f34ce924b6a07a.

[Reporting paper](<https://www.sota2.com/research/paper/69cca6a20636e5bf4afcbc4a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67041e209131cea13c79.md>)

Recorded evaluation configuration: {"q":"5.0","Backbone":"CNN"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
