HSFL: Efficient and Privacy-Preserving Offloading for Split and Federated Learning in IoT Services

Ruijun Deng, Xin Du, Zhihui Lu, Qiang Duan, Shih Chia Huang, Jie Wu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

Distributed machine learning methods like Federated Learning (FL) and Split Learning (SL) meet the growing demands of processing large-scale datasets under privacy restrictions. Recently, FL and SL are combined in hybrid SLFL (SFL) frameworks to exploit both methods' advantages to facilitate ubiquitous intelligence in the Internet of Things (IoT), for example, smart finance. Despite its significant impact on the performance and costs of SFL, model decomposition that splits an ML model into the client-server pair has not been sufficiently studied, especially for SFL in a large-scale dynamic IoT environment. In this paper, we propose a new SFL framework HSFL with a lightweight model decomposition method to offload a part of model training to the edge server. Specifically, we develop a method for estimating the training latency of HSFL and designed a metric for measuring privacy leakage in HSFL, based on which we formulate model decomposition in HSFL as an optimization problem with privacy protection as a constraint. Then, we transform the formulated problem into a contextual bandit problem and design an efficient algorithm to solve it. We have conducted thorough evaluations of the proposed HSFL framework through extensive experiments on a prototype testbed and a simulation platform. The experimental results validate the superiority of HSFL over the state-of-the-art benchmarks in terms of training latency, efficiency, scalability, and privacy protection.

Original languageEnglish (US)
Title of host publicationProceedings - 2023 IEEE International Conference on Web Services, ICWS 2023
EditorsClaudio Ardagna, Boualem Benatallah, Hongyi Bian, Carl K. Chang, Rong N. Chang, Jing Fan, Geoffrey C. Fox, Zhi Jin, Xuanzhe Liu, Heiko Ludwig, Michael Sheng, Jian Yang
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages658-668
Number of pages11
ISBN (Electronic)9798350304855
DOIs
StatePublished - 2023
Event2023 IEEE International Conference on Web Services, ICWS 2023 - Hybrid, Chicago, United States
Duration: Jul 2 2023Jul 8 2023

Publication series

NameProceedings - 2023 IEEE International Conference on Web Services, ICWS 2023

Conference

Conference2023 IEEE International Conference on Web Services, ICWS 2023
Country/TerritoryUnited States
CityHybrid, Chicago
Period7/2/237/8/23

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Networks and Communications
  • Computer Science Applications
  • Information Systems
  • Information Systems and Management

Cite this