# FedDiverse: Tackling Data Heterogeneity in Federated Learning with Diversity-Driven Client Selection

Source: [FedDiverse: Tackling Data Heterogeneity in Federated Learning with Diversity-Driven Client Selection](<https://www.sota2.com/research/paper/68fa7b681e209131cea883c0>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T07:02:34.980Z

Authors: Gergely D. N\\'emeth, Eros Fan\\\`i, Yeat Jeng Ng, Barbara Caputo, Miguel \\'Angel Lozano, Nuria Oliver, Novi Quadrianto

Published: 2025-04-15T14:20:42.000Z

## Abstract

Federated Learning (FL) enables decentralized training of machine learning models on distributed data while preserving privacy. However, in real-world FL settings, client data is often non-identically distributed and imbalanced, resulting in statistical data heterogeneity which impacts the generalization capabilities of the server's model across clients, slows convergence and reduces performance. In this paper, we address this challenge by proposing first a characterization of statistical data heterogeneity by means of 6 metrics of global and client attribute imbalance, class imbalance, and spurious correlations. Next, we create and share 7 computer vision datasets for binary and multiclass image classification tasks in Federated Learning that cover a broad range of statistical data heterogeneity and hence simulate real-world situations. Finally, we propose FEDDIVERSE, a novel client selection algorithm in FL which is designed to manage and leverage data heterogeneity across clients by promoting collaboration between clients with complementary data distributions. Experiments on the seven proposed FL datasets demonstrate FEDDIVERSE's effectiveness in enhancing the performance and robustness of a variety of FL methods while having low communication and computational overhead.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2504.11216>)

[PDF](<https://arxiv.org/pdf/2504.11216.pdf>)
