Communication-Efficient Framework for Distributed Image Semantic Wireless Transmission

被引:1
|
作者
Xie, Bingyan [1 ,2 ]
Wu, Yongpeng [3 ]
Shi, Yuxuan [4 ]
Ng, Derrick Wing Kwan [5 ]
Zhang, Wenjun [3 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[2] ZGC Inst Ubiquitous X Innovat & Applicat, R&D Dept 6G, Beijing 100083, Peoples R China
[3] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[4] Shanghai Jiao Tong Univ, Sch Cyber & Engn, Shanghai 200240, Peoples R China
[5] Univ New South Wales, Sch Elect Engn & Telecommun, Sydney, NSW 2052, Australia
关键词
Channel state information (CSI); distributed image transmission; hierarchical vision transformer (HVT); Internet of Things (IoT); semantic communication;
D O I
10.1109/JIOT.2023.3304650
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multinode communication, which refers to the interaction among multiple devices, has attracted lots of attention in many Internet of Things (IoT) scenarios. However, its huge amounts of data flows and inflexibility for task extension have triggered the urgent requirement of communication-efficient distributed data transmission frameworks. In this article, inspired by the great superiorities on bandwidth reduction and task adaptation of semantic communications, we propose a federated learning (FL)-based semantic communication (FLSC) framework for multitask distributed image transmission with IoT devices. FL enables the design of independent semantic communication link of each user while further improves the semantic extraction and task performance through global aggregation. Each link in FLSC is composed of a hierarchical vision transformer (HVT)-based extractor and a task-adaptive translator for coarse-to-fine semantic extraction and meaning translation according to specific tasks. In order to extend the FLSC into more realistic conditions, we design a channel state information-based multiple-input-multiple-output transmission module to combat channel fading and noise. Simulation results show that the coarse semantic information can deal with a range of image-level tasks. Moreover, especially in low signal-to-noise ratio (SNR) and channel bandwidth ratio regimes, FLSC evidently outperforms the traditional scheme, e.g., about 10 peak SNR gain in the 3-dB channel condition.
引用
收藏
页码:22555 / 22568
页数:14
相关论文
共 50 条
  • [21] Communication-Efficient Distributed Optimization with Quantized Preconditioners
    Alimisis, Foivos
    Davies, Peter
    Alistarh, Dan
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [22] Efficient hybrid framework for wireless image transmission.
    Kozintsev, I
    Ramchandran, K
    GLOBECOM 97 - IEEE GLOBAL TELECOMMUNICATIONS CONFERENCE, CONFERENCE RECORD, VOLS 1-3, 1997, : 1037 - 1041
  • [23] Communication-Efficient Δ-Stepping for Distributed Computing Systems
    Zhang, Haomeng
    Xie, Junfei
    Zhang, Xinyu
    2023 19TH INTERNATIONAL CONFERENCE ON WIRELESS AND MOBILE COMPUTING, NETWORKING AND COMMUNICATIONS, WIMOB, 2023, : 369 - 374
  • [24] Communication-efficient Massively Distributed Connected Components
    Lamm, Sebastian
    Sanders, Peter
    2022 IEEE 36TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS 2022), 2022, : 302 - 312
  • [25] More communication-efficient distributed sparse learning
    Zhou, Xingcai
    Yang, Guang
    INFORMATION SCIENCES, 2024, 668
  • [26] Gradient Sparsification for Communication-Efficient Distributed Optimization
    Wangni, Jianqiao
    Wang, Jialei
    Liu, Ji
    Zhang, Tong
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [27] Communication-efficient distributed mining of association rules
    Schuster, A
    Wolff, R
    SIGMOD RECORD, 2001, 30 (02) : 473 - 484
  • [28] Communication-efficient Conformal Prediction for Distributed Datasets
    Riquelme-Granada, Nery
    Luo, Zhiyuan
    Khuong An Nguyen
    CONFORMAL AND PROBABILISTIC PREDICTION WITH APPLICATIONS, VOL 179, 2022, 179
  • [29] Communication-efficient estimation for distributed subset selection
    Chen, Yan
    Dong, Ruipeng
    Wen, Canhong
    STATISTICS AND COMPUTING, 2023, 33 (06)
  • [30] Harvesting Curvatures for Communication-Efficient Distributed Optimization
    Cardoso, Diogo
    Li, Boyue
    Chi, Yuejie
    Xavier, Joao
    2022 56TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2022, : 749 - 753