Communication-Efficient Framework for Distributed Image Semantic Wireless Transmission

被引:1
|
作者
Xie, Bingyan [1 ,2 ]
Wu, Yongpeng [3 ]
Shi, Yuxuan [4 ]
Ng, Derrick Wing Kwan [5 ]
Zhang, Wenjun [3 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[2] ZGC Inst Ubiquitous X Innovat & Applicat, R&D Dept 6G, Beijing 100083, Peoples R China
[3] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[4] Shanghai Jiao Tong Univ, Sch Cyber & Engn, Shanghai 200240, Peoples R China
[5] Univ New South Wales, Sch Elect Engn & Telecommun, Sydney, NSW 2052, Australia
关键词
Channel state information (CSI); distributed image transmission; hierarchical vision transformer (HVT); Internet of Things (IoT); semantic communication;
D O I
10.1109/JIOT.2023.3304650
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multinode communication, which refers to the interaction among multiple devices, has attracted lots of attention in many Internet of Things (IoT) scenarios. However, its huge amounts of data flows and inflexibility for task extension have triggered the urgent requirement of communication-efficient distributed data transmission frameworks. In this article, inspired by the great superiorities on bandwidth reduction and task adaptation of semantic communications, we propose a federated learning (FL)-based semantic communication (FLSC) framework for multitask distributed image transmission with IoT devices. FL enables the design of independent semantic communication link of each user while further improves the semantic extraction and task performance through global aggregation. Each link in FLSC is composed of a hierarchical vision transformer (HVT)-based extractor and a task-adaptive translator for coarse-to-fine semantic extraction and meaning translation according to specific tasks. In order to extend the FLSC into more realistic conditions, we design a channel state information-based multiple-input-multiple-output transmission module to combat channel fading and noise. Simulation results show that the coarse semantic information can deal with a range of image-level tasks. Moreover, especially in low signal-to-noise ratio (SNR) and channel bandwidth ratio regimes, FLSC evidently outperforms the traditional scheme, e.g., about 10 peak SNR gain in the 3-dB channel condition.
引用
收藏
页码:22555 / 22568
页数:14
相关论文
共 50 条
  • [1] CoCoA: A General Framework for Communication-Efficient Distributed Optimization
    Smith, Virginia
    Forte, Simone
    Ma, Chenxin
    Takac, Martin
    Jordan, Michael I.
    Jaggi, Martin
    JOURNAL OF MACHINE LEARNING RESEARCH, 2018, 18
  • [2] A communication-efficient distributed deep learning remote sensing image change detection framework
    Cheng, Hongquan
    Zheng, Jie
    Wu, Huayi
    Qi, Kunlun
    He, Lihua
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2024, 129
  • [3] FedBCD: A Communication-Efficient Collaborative Learning Framework for Distributed Features
    Liu, Yang
    Zhang, Xinwei
    Kang, Yan
    Li, Liping
    Chen, Tianjian
    Hong, Mingyi
    Yang, Qiang
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2022, 70 : 4277 - 4290
  • [4] Communication-Efficient and Distributed Learning Over Wireless Networks: Principles and Applications
    Park, Jihong
    Samarakoon, Sumudu
    Elgabli, Anis
    Kim, Joongheon
    Bennis, Mehdi
    Kim, Seong-Lyun
    Debbah, Merouane
    PROCEEDINGS OF THE IEEE, 2021, 109 (05) : 796 - 819
  • [5] Communication-Efficient Distributed Eigenspace Estimation
    Charisopoulos, Vasileios
    Benson, Austin R.
    Damle, Anil
    SIAM JOURNAL ON MATHEMATICS OF DATA SCIENCE, 2021, 3 (04): : 1067 - 1092
  • [6] FAST AND COMMUNICATION-EFFICIENT DISTRIBUTED PCA
    Gang, Arpita
    Raja, Haroon
    Bajwa, Waheed U.
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 7450 - 7454
  • [7] Communication-efficient distributed oblivious transfer
    Beimel, Amos
    Chee, Yeow Meng
    Wang, Huaxiong
    Zhang, Liang Feng
    JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 2012, 78 (04) : 1142 - 1157
  • [8] Communication-Efficient Distributed Skyline Computation
    Zhang, Haoyu
    Zhang, Qin
    CIKM'17: PROCEEDINGS OF THE 2017 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2017, : 437 - 446
  • [9] Communication-efficient Distributed SGD with Sketching
    Ivkin, Nikita
    Rothchild, Daniel
    Ullah, Enayat
    Braverman, Vladimir
    Stoica, Ion
    Arora, Raman
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [10] Communication-Efficient Distributed Learning: An Overview
    Cao, Xuanyu
    Basar, Tamer
    Diggavi, Suhas
    Eldar, Yonina C.
    Letaief, Khaled B.
    Poor, H. Vincent
    Zhang, Junshan
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (04) : 851 - 873