Reducing Communication Costs of Federated Contrastive Learning by Particle Swarm Optimization

Zesheng Liu, Tao Zhu, Zhenyu Liu, Huansheng Ning, Liming Chen

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Federated learning and contrastive learning are two important machine learning paradigms, and federated contrastive learning is their combination, allowing pretraining models using unlabeled data in the context of data silos while protecting the data privacy and security. However, existing federated contrastive learning algorithms require transmission of model weights and data representations among the sever and clients, which is costly and greatly increases data security risks. Therefore, how to reduce the amount of data communication, especially the representations, while maintaining the performance of the model is an important problem that has not yet received any attention. In this study, we propose Federated Contrastive Learning Algorithm using Particle Swarm Optimization to reduce data communication by transmitting the client model scores instead. In the experiments, our proposed method can reduce 40% weight uploads and 78.97% representation uploads compared with the baseline algorithm, while with only 1.93% decrease in accuracy.
Original languageEnglish
Title of host publication2021 3rd International Academic Exchange Conference on Science and Technology Innovation (IAECST)
PublisherIEEE
ISBN (Electronic)978-1-6654-0267-5, 978-1-6654-0266-8
ISBN (Print)978-1-6654-0268-2
DOIs
Publication statusPublished - 7 Dec 2022
Event2021 3rd International Academic Exchange Conference on Science and Technology Innovation (IAECST) - Guangzhou, China
Duration: 10 Dec 202112 Dec 2021
https://ieeexplore.ieee.org/xpl/conhome/9695521/proceeding

Conference

Conference2021 3rd International Academic Exchange Conference on Science and Technology Innovation (IAECST)
Abbreviated titleIAECST
Country/TerritoryChina
CityGuangzhou
Period10/12/2112/12/21
Internet address

Fingerprint

Dive into the research topics of 'Reducing Communication Costs of Federated Contrastive Learning by Particle Swarm Optimization'. Together they form a unique fingerprint.

Cite this