Communication-Efficient Framework for Distributed Image Semantic Wireless Transmission

被引:1
|
作者
Xie, Bingyan [1 ,2 ]
Wu, Yongpeng [3 ]
Shi, Yuxuan [4 ]
Ng, Derrick Wing Kwan [5 ]
Zhang, Wenjun [3 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[2] ZGC Inst Ubiquitous X Innovat & Applicat, R&D Dept 6G, Beijing 100083, Peoples R China
[3] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[4] Shanghai Jiao Tong Univ, Sch Cyber & Engn, Shanghai 200240, Peoples R China
[5] Univ New South Wales, Sch Elect Engn & Telecommun, Sydney, NSW 2052, Australia
关键词
Channel state information (CSI); distributed image transmission; hierarchical vision transformer (HVT); Internet of Things (IoT); semantic communication;
D O I
10.1109/JIOT.2023.3304650
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multinode communication, which refers to the interaction among multiple devices, has attracted lots of attention in many Internet of Things (IoT) scenarios. However, its huge amounts of data flows and inflexibility for task extension have triggered the urgent requirement of communication-efficient distributed data transmission frameworks. In this article, inspired by the great superiorities on bandwidth reduction and task adaptation of semantic communications, we propose a federated learning (FL)-based semantic communication (FLSC) framework for multitask distributed image transmission with IoT devices. FL enables the design of independent semantic communication link of each user while further improves the semantic extraction and task performance through global aggregation. Each link in FLSC is composed of a hierarchical vision transformer (HVT)-based extractor and a task-adaptive translator for coarse-to-fine semantic extraction and meaning translation according to specific tasks. In order to extend the FLSC into more realistic conditions, we design a channel state information-based multiple-input-multiple-output transmission module to combat channel fading and noise. Simulation results show that the coarse semantic information can deal with a range of image-level tasks. Moreover, especially in low signal-to-noise ratio (SNR) and channel bandwidth ratio regimes, FLSC evidently outperforms the traditional scheme, e.g., about 10 peak SNR gain in the 3-dB channel condition.
引用
收藏
页码:22555 / 22568
页数:14
相关论文
共 50 条
  • [41] Predictive and Adaptive Deep Coding for Wireless Image Transmission in Semantic Communication
    Zhang, Wenyu
    Zhang, Haijun
    Ma, Hui
    Shao, Hua
    Wang, Ning
    Leung, Victor C. M.
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (08) : 5486 - 5501
  • [42] Spectral efficient compressive transmission framework for wireless communication systems
    Sharma, Shree Krishna
    Patwary, Mohammad
    Abdel-Maguid, Mohamed
    IET SIGNAL PROCESSING, 2013, 7 (07) : 558 - 564
  • [43] Communication-Efficient and Resilient Distributed Q-Learning
    Xie, Yijing
    Mou, Shaoshuai
    Sundaram, Shreyas
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (03) : 3351 - 3364
  • [44] Communication-Efficient Distributed Learning of Discrete Probability Distributions
    Diakonikolas, Ilias
    Grigorescu, Elena
    Li, Jerry
    Natarajan, Abhiram
    Onak, Krzysztof
    Schmidt, Ludwig
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [45] Communication-efficient Distributed Sparse Linear Discriminant Analysis
    Tian, Lu
    Gu, Quanquan
    ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 54, 2017, 54 : 1178 - 1187
  • [46] Communication-Efficient Wireless Traffic Prediction with Federated Learning
    Gao, Fuwei
    Zhang, Chuanting
    Qiao, Jingping
    Li, Kaiqiang
    Cao, Yi
    MATHEMATICS, 2024, 12 (16)
  • [47] Local Stochastic ADMM for Communication-Efficient Distributed Learning
    ben Issaid, Chaouki
    Elgabli, Anis
    Bennis, Mehdi
    2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 1880 - 1885
  • [48] A Communication-Efficient Distributed Clustering Algorithm for Sensor Networks
    Taherkordi, Amirhosein
    Mohammadi, Reza
    Eliassen, Frank
    2008 22ND INTERNATIONAL WORKSHOPS ON ADVANCED INFORMATION NETWORKING AND APPLICATIONS, VOLS 1-3, 2008, : 634 - +
  • [49] Communication-Efficient Distributed Cooperative Learning With Compressed Beliefs
    Toghani, Mohammad Taha
    Uribe, Cesar A.
    IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2022, 9 (03): : 1215 - 1226
  • [50] Manifold Identification for Ultimately Communication-Efficient Distributed Optimization
    Li, Yu-Sheng
    Chiang, Wei-Lin
    Lee, Ching-pei
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119