Communication-Efficient Federated Learning in Drone-Assisted IoT Networks: Path Planning and Enhanced Knowledge Distillation Techniques

被引:4
|
作者
Gad, Gad [1 ]
Farrag, Aya [1 ]
Fadlullah, Zubair Md [2 ]
Fouda, Mostafa M. [3 ,4 ]
机构
[1] Lakehead Univ, Dept Comp Sci, Thunder Bay, ON, Canada
[2] Western Univ, Dept Comp Sci, London, ON, Canada
[3] Idaho State Univ, Dept Elect & Comp Engn, Pocatello, ID USA
[4] Ctr Adv Energy Studies CAES, Idaho Falls, ID USA
关键词
Deep learning; UAV networks; drone-aided LoRa networks; edge devices; Federated Learning (FL); digital health and well-being; Knowledge Distillation; Self-Organizing Maps;
D O I
10.1109/PIMRC56721.2023.10294036
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As 5G and beyond networks continue to proliferate, intelligent monitoring systems are becoming increasingly prevalent. However, geographically isolated regions with sparse populations still face difficulties in accessing these technologies due to infrastructure deployment challenges. Additionally, the high cost and unreliability of satellite Internet services make them less appealing. This paper studies the challenges of droneaided networks and presents a communication-efficient Federated Learning (FL) system on a drone-aided Internet of Things (IoT) network to facilitate health analysis in rural areas over LoRa wireless links. The proposed approach consists of two primary components. Firstly, optimizing the drone's trajectory is theoretically formulated as a modified version of the Traveling Salesman Problem (TSP), with the Self-Organizing Map (SOM) algorithm employed for effective route planning. Secondly, the Knowledge Distillation (KD)-based FL algorithm is utilized to reduce communication overhead by leveraging soft labels. The quality of drone routes generated by the SOM is evaluated on multi-scale maps with pre-determined optimal paths. The experiments reveal SOM's ability to accurately represent node topologies and yield cost-effective Hamiltonian cycles. The KD-based FL proves to be more efficient in terms of communication than FedAvg as the former exchanges soft labels while the latter exchanges model weights, thus reducing drone waiting time and battery consumption. We showcase the performance of our KD-based FL algorithm using Human Activity Recognition (HAR) datasets, illustrating a communication-efficient alternative for distributed learning, offering competitive performance leveraging a shared dataset for knowledge transfer among IoT devices.
引用
收藏
页数:7
相关论文
共 45 条
  • [31] FedET: A Communication-Efficient Federated Class-Incremental Learning Framework Based on Enhanced Transformer
    Liu, Chenghao
    Qu, Xiaoyang
    Wang, Jianzong
    Xiao, Jing
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 3984 - 3992
  • [32] Digital Twin Enhanced Federated Reinforcement Learning With Lightweight Knowledge Distillation in Mobile Networks
    Zhou, Xiaokang
    Zheng, Xuzhe
    Cui, Xuesong
    Shi, Jiashuai
    Liang, Wei
    Yan, Zheng
    Yang, Laurence T.
    Shimizu, Shohei
    Wang, Kevin I-Kai
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (10) : 3191 - 3211
  • [33] Communication-efficient semi-synchronous hierarchical federated learning with balanced training in heterogeneous IoT edge environments
    Herabad, Mohammadsadeq Garshasbi
    INTERNET OF THINGS, 2023, 21
  • [34] Federated Learning in Massive MIMO 6G Networks: Convergence Analysis and Communication-Efficient Design
    Mu, Yuchen
    Garg, Navneet
    Ratnarajah, Tharmalingam
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (06): : 4220 - 4234
  • [35] Base Station Dataset-Assisted Broadband Over-the-Air Aggregation for Communication-Efficient Federated Learning
    Hong, Jun-Pyo
    Park, Sangjun
    Choi, Wan
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (11) : 7259 - 7272
  • [36] Communication-Efficient Massive UAV Online Path Control: Federated Learning Meets Mean-Field Game Theory
    Shiri, Hamid
    Park, Jihong
    Bennis, Mehdi
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (11) : 6840 - 6857
  • [37] Communication-Efficient Massive UAV Online Path Control: Federated Learning Meets Mean-Field Game Theory
    Shiri, Hamid
    Park, Jihong
    Bennis, Mehdi
    arXiv, 2020,
  • [38] Communication-Efficient Federated Deep Reinforcement Learning Based Cooperative Edge Caching in Fog Radio Access Networks
    Zhang, Min
    Jiang, Yanxiang
    Zheng, Fu-Chun
    Wang, Dongming
    Bennis, Mehdi
    Jamalipour, Abbas
    You, Xiaohu
    IEEE Transactions on Wireless Communications, 2024, 23 (12) : 18409 - 18422
  • [39] Deep Anomaly Detection for Time-Series Data in Industrial IoT: A Communication-Efficient On-Device Federated Learning Approach
    Liu, Yi
    Garg, Sahil
    Nie, Jiangtian
    Zhang, Yang
    Xiong, Zehui
    Kang, Jiawen
    Hossain, M. Shamim
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (08) : 6348 - 6358
  • [40] Tensor-Enabled Communication-Efficient and Trustworthy Federated Learning for Heterogeneous Intelligent Space-Air-Ground-Integrated IoT
    Zhao, Ruonan
    Yang, Laurence T.
    Liu, Debin
    Lu, Wanli
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (23) : 20285 - 20296