An Efficient Decentralized Federated Learning Framework Based on Directed Acyclic Graph

被引:0
|
作者
Wu, Da [1 ]
Zang, Xiuhuan [2 ]
Chen, Jiewei [1 ]
Wu, Xinping [2 ]
Lu, Yu [3 ]
Qi, Feng [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Beijing 100876, Peoples R China
[2] State Grid Econ & Technol Res Inst Co LTD, Beijing 102200, Peoples R China
[3] State Grid Jilin Elect Power Co LTD, Econ & Technol Res Inst, Changchun 130022, Peoples R China
关键词
Blockchain; Security and privacy; Federated learning; Communication efficiency;
D O I
10.1007/978-981-99-9243-0_22
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Federated Learning (FL) has gained significant attention and application in the field of Internet of Things (IoT). To address inherent vulnerabilities and trust risks in traditional centralized FL architectures, blockchain technology has been utilized to construct decentralized and trusted FL systems in the IoT domain. Nevertheless, conventional blockchain consensus mechanisms, such as Proof-of-Work (PoW), often impose substantial additional resource consumption. Furthermore, FL systems often involve large-scale model training, leading to considerable communication costs and storage pressures on the blockchain. This paper presents a novel lightweight, trusted, and decentralized FL architecture called DTFed, which is based on directed acyclic graph (DAG) ledger technology. DTFed exploits DAG ledger technology to establish an asynchronous FL system, leveraging the lightweight and efficient consensus mechanism of DAG to ensure system security. To mitigate communication costs while preserving effective FL performance, we adopt the concept of knowledge distillation. Soft labels are employed as intermediate results of Federated Learning instead of traditional model parameters, resulting in reduced communication costs. The experimental results demonstrate that DTFed enhances training efficiency, communication efficiency, and security compared to existing popular frameworks.
引用
收藏
页码:209 / 220
页数:12
相关论文
共 50 条
  • [1] Graph Federated Learning Based on the Decentralized Framework
    Liu, Peilin
    Tang, Yanni
    Zhang, Mingyue
    Chen, Wu
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT III, 2023, 14256 : 452 - 463
  • [2] Personalized federated learning via directed acyclic graph based blockchain
    Huang C.
    Liu E.
    Wang R.
    Liu Y.
    Zhang H.
    Geng Y.
    Wang J.
    Han S.
    [J]. IET Blockchain, 2024, 4 (01): : 73 - 82
  • [3] Decentralized Directed acyclic graph based DLT Network
    Saad, A.
    Park, Soo Young
    [J]. INTERNATIONAL CONFERENCE ON OMNI-LAYER INTELLIGENT SYSTEMS (COINS), 2019, : 158 - 163
  • [4] A rough set framework for learning in a directed acyclic graph
    Midelfart, H
    Komorowski, J
    [J]. ROUGH SETS AND CURRENT TRENDS IN COMPUTING, PROCEEDINGS, 2002, 2475 : 144 - 155
  • [5] An efficient federated learning framework for graph learning in hyperbolic space
    Du, Haizhou
    Liu, Conghao
    Liu, Haotian
    Ding, Xiaoyu
    Huo, Huan
    [J]. KNOWLEDGE-BASED SYSTEMS, 2024, 289
  • [6] Efficient Learning by Directed Acyclic Graph For Resource Constrained Prediction
    Wang, Joseph
    Trapeznikov, Kirill
    Saligrama, Venkatesh
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 28 (NIPS 2015), 2015, 28
  • [7] Asynchronous federated learning with directed acyclic graph-based blockchain in edge computing: Overview, design, and challenges
    Ko, Seoyoung
    Lee, Keewoo
    Cho, Hyunhum
    Hwang, Yoonjae
    Jang, Huisu
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2023, 223
  • [8] An Efficient Blockchain Assisted Reputation Aware Decentralized Federated Learning Framework
    Kasyap, Harsh
    Manna, Arpan
    Tripathy, Somanath
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2023, 20 (03): : 2771 - 2782
  • [9] IPLS: A Framework for Decentralized Federated Learning
    Pappas, Christodoulos
    Chatzopoulos, Dimitris
    Lalis, Spyros
    Vavalis, Manolis
    [J]. 2021 IFIP NETWORKING CONFERENCE AND WORKSHOPS (IFIP NETWORKING), 2021,
  • [10] Learning directed acyclic graph models based on sparsest permutations
    Raskutti, Garvesh
    Uhler, Caroline
    [J]. STAT, 2018, 7 (01):