Data-Free Knowledge Distillation for Heterogeneous Federated Learning.

ABSTRACT: Federated Learning (FL) is a decentralized machine-learning paradigm in which a global server iteratively aggregates the model parameters of local users without accessing their data. User heterogeneity has imposed significant challenges to FL, which can incur drifted global models that are slow to converge. Knowledge Distillation has recently emerged to tackle this issue, by refining the server model using aggregated knowledge from heterogeneous users, other than directly aggregating their model parameters. This approach, however, depends on a proxy dataset, making it impractical unless such prerequisite is satisfied. Moreover, the ensemble knowledge is not fully utilized to guide local model learning, which may in turn affect the quality of the aggregated model. In this work

SUBMITTER: Zhu Z 

PROVIDER: S-EPMC9036494 | biostudies-literature | 2021 Jul

REPOSITORIES: biostudies-literature