Communication-Efficient Framework for Distributed Image Semantic Wireless Transmission

被引:1
|
作者
Xie, Bingyan [1 ,2 ]
Wu, Yongpeng [3 ]
Shi, Yuxuan [4 ]
Ng, Derrick Wing Kwan [5 ]
Zhang, Wenjun [3 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[2] ZGC Inst Ubiquitous X Innovat & Applicat, R&D Dept 6G, Beijing 100083, Peoples R China
[3] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[4] Shanghai Jiao Tong Univ, Sch Cyber & Engn, Shanghai 200240, Peoples R China
[5] Univ New South Wales, Sch Elect Engn & Telecommun, Sydney, NSW 2052, Australia
关键词
Channel state information (CSI); distributed image transmission; hierarchical vision transformer (HVT); Internet of Things (IoT); semantic communication;
D O I
10.1109/JIOT.2023.3304650
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multinode communication, which refers to the interaction among multiple devices, has attracted lots of attention in many Internet of Things (IoT) scenarios. However, its huge amounts of data flows and inflexibility for task extension have triggered the urgent requirement of communication-efficient distributed data transmission frameworks. In this article, inspired by the great superiorities on bandwidth reduction and task adaptation of semantic communications, we propose a federated learning (FL)-based semantic communication (FLSC) framework for multitask distributed image transmission with IoT devices. FL enables the design of independent semantic communication link of each user while further improves the semantic extraction and task performance through global aggregation. Each link in FLSC is composed of a hierarchical vision transformer (HVT)-based extractor and a task-adaptive translator for coarse-to-fine semantic extraction and meaning translation according to specific tasks. In order to extend the FLSC into more realistic conditions, we design a channel state information-based multiple-input-multiple-output transmission module to combat channel fading and noise. Simulation results show that the coarse semantic information can deal with a range of image-level tasks. Moreover, especially in low signal-to-noise ratio (SNR) and channel bandwidth ratio regimes, FLSC evidently outperforms the traditional scheme, e.g., about 10 peak SNR gain in the 3-dB channel condition.
引用
收藏
页码:22555 / 22568
页数:14
相关论文
共 50 条
  • [11] Communication-Efficient Distributed Statistical Inference
    Jordan, Michael I.
    Lee, Jason D.
    Yang, Yun
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2019, 114 (526) : 668 - 681
  • [12] Communication-efficient distributed EM algorithm
    Liu, Xirui
    Wu, Mixia
    Xu, Liwen
    STATISTICAL PAPERS, 2024, : 5575 - 5592
  • [13] Contrastive Learning based Semantic Communication for Wireless Image Transmission
    Tang, Shunpu
    Yang, Qianqian
    Fan, Lisheng
    Lei, Xianfu
    Deng, Yansha
    Nallanathan, Arumugam
    2023 IEEE 98TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-FALL, 2023,
  • [14] Efficient-Adam: Communication-Efficient Distributed Adam
    Chen C.
    Shen L.
    Liu W.
    Luo Z.-Q.
    IEEE Transactions on Signal Processing, 2023, 71 : 3257 - 3266
  • [15] Communication-Efficient Distributed Mining of Association Rules
    Assaf Schuster
    Ran Wolff
    Data Mining and Knowledge Discovery, 2004, 8 : 171 - 196
  • [16] Communication-Efficient Distributed PCA by Riemannian Optimization
    Huang, Long-Kai
    Pan, Sinno Jialin
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [17] Double Quantization for Communication-Efficient Distributed Optimization
    Huang, Longbo
    PROCEEDINGS OF THE 13TH EAI INTERNATIONAL CONFERENCE ON PERFORMANCE EVALUATION METHODOLOGIES AND TOOLS ( VALUETOOLS 2020), 2020, : 2 - 2
  • [18] Communication-Efficient Distributed Dual Coordinate Ascent
    Jaggi, Martin
    Smith, Virginia
    Takac, Martin
    Terhorst, Jonathan
    Krishnan, Sanjay
    Hofmann, Thomas
    Jordan, Michael, I
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 27 (NIPS 2014), 2014, 27
  • [19] Double Quantization for Communication-Efficient Distributed Optimization
    Yu, Yue
    Wu, Jiaxiang
    Huang, Longbo
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [20] Towards Communication-Efficient Distributed Background Subtraction
    Hung Ngoc Phan
    Synh Viet-Uyen Ha
    Phuong Hoai Ha
    RECENT CHALLENGES IN INTELLIGENT INFORMATION AND DATABASE SYSTEMS, ACIIDS 2022, 2022, 1716 : 490 - 502