TY - JOUR
T1 - CoLLaRS
T2 - A cloud–edge–terminal collaborative lifelong learning framework for AIoT
AU - Hu, Shijing
AU - Lin, Junxiong
AU - Lu, Zhihui
AU - Du, Xin
AU - Duan, Qiang
AU - Huang, Shih Chia
N1 - Publisher Copyright:
© 2024 Elsevier B.V.
PY - 2024/9
Y1 - 2024/9
N2 - AIoT applications often encounter challenges such as terminal resource constraints, data drift, and data heterogeneity in real world, leading to problems such as catastrophic forgetting, low generalization ability, and low accuracy during model training. To address these challenges, we proposed CoLLaRS, a cloud–edge–terminal collaborative lifelong learning framework for AIoT applications. In the CoLLaRS framework, we alleviate the problem of terminal resource constraints by uploading terminal tasks at the edge. CoLLaRS uses continuous training at the edge to achieve lifelong learning training of the model and solve the problem of catastrophic forgetting. CoLLaRS employs federated optimization in the cloud to perform personalized aggregation of different edge models and solve the problem of weak model generalization ability. Finally, the model is fine-tuned at the terminal to further optimize its accuracy in local tasks. Our experiments on real-world datasets showed that CoLLaRS has an 8% improvement in accuracy and a 5% improvement in backward transfer(BWT) and forward transfer(FWT) compared to other baseline algorithms. The results of the ablation experiments further confirmed the effectiveness of CoLLaRS.
AB - AIoT applications often encounter challenges such as terminal resource constraints, data drift, and data heterogeneity in real world, leading to problems such as catastrophic forgetting, low generalization ability, and low accuracy during model training. To address these challenges, we proposed CoLLaRS, a cloud–edge–terminal collaborative lifelong learning framework for AIoT applications. In the CoLLaRS framework, we alleviate the problem of terminal resource constraints by uploading terminal tasks at the edge. CoLLaRS uses continuous training at the edge to achieve lifelong learning training of the model and solve the problem of catastrophic forgetting. CoLLaRS employs federated optimization in the cloud to perform personalized aggregation of different edge models and solve the problem of weak model generalization ability. Finally, the model is fine-tuned at the terminal to further optimize its accuracy in local tasks. Our experiments on real-world datasets showed that CoLLaRS has an 8% improvement in accuracy and a 5% improvement in backward transfer(BWT) and forward transfer(FWT) compared to other baseline algorithms. The results of the ablation experiments further confirmed the effectiveness of CoLLaRS.
UR - https://www.scopus.com/pages/publications/85192162469
UR - https://www.scopus.com/inward/citedby.url?scp=85192162469&partnerID=8YFLogxK
U2 - 10.1016/j.future.2024.04.046
DO - 10.1016/j.future.2024.04.046
M3 - Article
AN - SCOPUS:85192162469
SN - 0167-739X
VL - 158
SP - 447
EP - 456
JO - Future Generation Computer Systems
JF - Future Generation Computer Systems
ER -