Blockchain-Assisted Semi-Centralized Federated Learning Framework

被引:0
|
作者
Shi H. [1 ,2 ]
Ma R. [1 ,2 ]
Zhang W. [3 ]
Guan H. [1 ,2 ]
机构
[1] School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai
[2] Shanghai Key Laboratory of Scalable Computing and Systems, Shanghai
[3] Qingdao Institute of Software, College of Computer Science and Technology, China University of Petroleum (East China), Shandong, Qingdao
关键词
blockchain system; federated learning; Internet of things; model aggregation; semi-centralized structure;
D O I
10.7544/issn1000-1239.202330286
中图分类号
学科分类号
摘要
With the development of network technology, building a trusted new-generation information management system is necessary. Blockchain technology provides a decentralized, transparent, and tamper-proof distributed base. On the other hand, with the development of artificial intelligence technology, data islands have been a common issue in the field of network data computing. The distrust among developers has made it difficult to jointly utilize all parties’ data for collaborative training. Although federated learning provides data privacy protection, there are still hidden dangers in server-side security. The traditional methods replace the server in the federated learning framework with a blockchain system to provide a tamperproof global model database. However, this approach does not utilize all available network connections in the Internet of things scenario and lacks a block structure design for federated learning tasks. We propose a blockchain-assisted semi-centralized federated learning framework. Starting from the requirements of the Internet of things scenario, our approach constructs a semi-centralized Internet of things structure and utilizes all trusted network connections to support federated learning tasks. At the same time, our approach constructs a tamper-proof model database for untrusted and remote clients through blockchain technology. Compared with traditional blockchain federated learning frameworks, our approach has a smaller communication overhead and better universality. The framework includes two major designs. The semi-centralized federated learning framework reduces the communication overhead brought by aggregation through trusted connections between clients, and stores client models through blockchain for aggregation on remote or untrusted clients to improve the universality and performance of local models. The design of blockchain blocks for federated learning tasks can support the needs of underlying federated learning training. Experiments have shown that this framework has an accuracy improvement at least 8% compared with traditional federated learning algorithms on multiple datasets, and significantly reduces the communication overhead caused by the waiting aggregation process between clients, providing guidance for the deployment of blockchain federated learning systems in practical scenarios. © 2023 Science Press. All rights reserved.
引用
收藏
页码:2567 / 2582
页数:15
相关论文
共 53 条
  • [1] Yang Yang, Ma Mulei, Wu Hequan, Et al., 6G network AI architecture for everyone-centric customized services[J/OL], IEEE Network, (2022)
  • [2] Rui Zhang, Xuesen Chu, Ruhui Ma, Et al., OSTTD: Offloading of splittable tasks with topological dependence in multi-tier computing networks[J], IEEE Journal on Selected Areas in Communications, 41, 2, pp. 555-568, (2023)
  • [3] Akabane A T, Immich R, Pazzi R W, Et al., TRUSTed: A distributed system for information management and knowledge distribution in VANETs[C], Proc of 2018 IEEE Symp on Computers and Communications, pp. 1-6, (2018)
  • [4] Yuan Shijing, Li Jie, Wu Chentao, JORA: Blockchain-based efficient joint computing offloading and resource allocation for edge video streaming systems, Journal of Systems Architecture, 133, (2022)
  • [5] Yangfei Lin, Jie Li, Kimura S, Et al., Consortium blockchain-based public integrity verification in cloud storage for IoT[J], IEEE Internet of Things Journal, 9, 5, pp. 3978-3987, (2021)
  • [6] Weishan Zhang, Gang Sun, Liang Xu, Et al., A trustworthy safety inspection framework using performance-security balanced blockchain[J], IEEE Internet of Things Journal, 9, 11, pp. 8178-8190, (2022)
  • [7] Shi Hongjian, Wang Hao, Ma Ruhui, Et al., Robust searching-based gradient collaborative management in intelligent transportation system, ACM Transactions on Multimedia Computing, Communications, and Applications, (2022)
  • [8] Lianmin Zheng, Li Zhuohan, Zhang Hao, Et al., Alpa: Automating inter- and intra-operator parallelism for distributed deep learning[C], Proc of the 16th USENIX Symp on Operating Systems Design and Implementation, pp. 559-578, (2022)
  • [9] Zhang Jiaru, Hua Yang, Song Tao, Et al., Improving Bayesian neural networks by adversarial sampling, Proc of the AAAI Conf on Artificial Intelligence, 36, 9, pp. 10110-10117, (2022)
  • [10] Zhaoyang Du, Wu C, Yoshinaga T, Et al., Federated learning for vehicular Internet of things: Recent advances and open issues[J], IEEE Open Journal of the Computer Society, 1, pp. 45-61, (2020)