Wake-word detection on Wake-word detection dataset (test)
0.92Relative FA (Device A)Self-FL
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Self-FLModel Scope=Global, Operating State=Normal2022.04 | 0.92 | 0.94 | 0.91 | 0.91 | 1.01 | |
| FedAvg-eModel Scope=Global, Aggregation Weighting=equal-weighted model averaging, Operating State=Normal2022.04 | 0.97 | 0.96 | 1 | 0.92 | 1 | |
| DITTO-eModel Scope=Global, Aggregation Weighting=equal-weighted model averaging, Operating State=Normal2022.04 | 0.97 | 0.95 | 1 | 0.93 | 0.99 | |
| PerFedAvgModel Scope=Global, Aggregation Weighting=equal-weighted aggregation, Operating State=Normal2022.04 | 1.06 | 0.98 | 1.08 | 0.93 | 1.01 | |
| DITTO-wModel Scope=Global, Aggregation Weighting=sample size-based weighted averaging, Operating State=Normal2022.04 | 8.38 | 4 | 12.75 | 8.61 | 10.23 | |
| FedAvg-wModel Scope=Global, Aggregation Weighting=sample size-based weighted averaging, Operating State=Normal2022.04 | 8.39 | 4 | 12.8 | 8.61 | 10.62 | |
| Self-FLModel Type=Personalized, Device State=Normal2022.04 | 93 | 91 | 90 | 90 | 99 | |
| FedAvg-eModel Type=Personalized, Device State=Normal, Aggregation=equal-weighted2022.04 | 95 | 95 | 93 | 91 | 98 | |
| DITTO-eModel Type=Personalized, Device State=Normal, Aggregation=equal-weighted2022.04 | 97 | 96 | 93 | 91 | 96 | |
| PerFedAvgModel Type=Personalized, Device State=Normal, Aggregation=equal-weighted2022.04 | 102 | 111 | 108 | 100 | 93 |