Deep Joint Source-Channel Coding for Wireless Image Transmission with Adaptive Models

被引:0
|
作者
Song, Mengshu [1 ]
Ma, Nan [1 ,2 ]
Dong, Chen [1 ]
Xu, Xiaodong [1 ,2 ]
Zhang, Ping [1 ,2 ]
机构
[1] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing 100876, Peoples R China
[2] Peng Cheng Lab, Dept Broadband Commun, Shenzhen 518066, Peoples R China
基金
中国国家自然科学基金;
关键词
semantic communication; deep learning; joint source-channel coding ([!text type='JS']JS[!/text]CC); semantic adaptive model selection (SAMS);
D O I
10.3390/electronics12224637
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The implementation of joint source-channel coding (JSCC) schemes using deep learning has accelerated the development of semantic communication research. Existing JSCC schemes based on deep learning (DL) are trained on a fixed signal-to-noise ratio (SNR); however, these trained models are not designed for scenarios in which the SNR is dynamic. Therefore, a novel semantic adaptive model for semantic communication-called joint source-channel coding with adaptive models (AMJSCC)-that has a semantic adaptive model selection (SAMS) module is proposed. The joint source-channel encoding (JSCE) model and the joint source-channel decoding (JSCD) model adapt according to both real-time channel conditions and system available computational power resources. Furthermore, residual networks with different layers are investigated to further improve the accuracy of information recovery. Simulation results demonstrate that our model can achieve higher recovery similarity and is more robust and adaptive to the SNR and communication resources. Meanwhile, compared to the state-of-the-art deep JSCC methods, it reduces storage space and communication resource consumption.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Deep Joint Source-Channel Coding for Wireless Image Transmission
    Bourtsoulatze, Eirina
    Kurka, David Burth
    Gunduz, Deniz
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2019, 5 (03) : 567 - 579
  • [2] DEEP JOINT SOURCE-CHANNEL CODING FOR WIRELESS IMAGE TRANSMISSION
    Bourtsoulatze, Eirina
    Kurka, David Burth
    Gunduz, Deniz
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 4774 - 4778
  • [3] DEEP JOINT SOURCE-CHANNEL CODING FOR WIRELESS IMAGE TRANSMISSION WITH ADAPTIVE RATE CONTROL
    Yang, Mingyu
    Kim, Hun-Seok
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 5193 - 5197
  • [4] SNR-ADAPTIVE DEEP JOINT SOURCE-CHANNEL CODING FOR WIRELESS IMAGE TRANSMISSION
    Ding, Mingze
    Li, Jiahui
    Ma, Mengyao
    Fan, Xiaopeng
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1555 - 1559
  • [5] Deep Joint Source-Channel Coding for Wireless Image Transmission with Semantic Importance
    Sun, Qizheng
    Guo, Caili
    Yang, Yang
    Chen, Jiujiu
    Tang, Rui
    Liu, Chuanhong
    2022 IEEE 96TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-FALL), 2022,
  • [6] DEEP JOINT SOURCE-CHANNEL CODING FOR WIRELESS IMAGE RETRIEVAL
    Jankowski, Mikolaj
    Gunduz, Deniz
    Mikolajczyk, Krystian
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 5070 - 5074
  • [7] Deep Joint Source-Channel Coding Based on Semantics of Pixels for Wireless Image Transmission
    Sun, Qizheng
    Guo, Caili
    Yang, Yang
    Tang, Rui
    Liu, Chuanhong
    2023 IEEE 34TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, PIMRC, 2023,
  • [8] Deep Joint Source-Channel Coding for Adaptive Image Transmission over MIMO Channels
    Wu H.
    Shao Y.
    Bian C.
    Mikolajczyk K.
    Gunduz D.
    IEEE Transactions on Wireless Communications, 2024, 23 (10) : 1 - 1
  • [9] Deep Joint Source-Channel Coding for Wireless Image Transmission with Entropy-Aware Adaptive Rate Control
    Chen, Weixuan
    Chen, Yuhao
    Yang, Qianqian
    Huang, Chongwen
    Wang, Qian
    Zhang, Zhaoyang
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 2239 - 2244
  • [10] Channel-Blind Joint Source-Channel Coding for Wireless Image Transmission
    Yuan, Hongjie
    Xu, Weizhang
    Wang, Yuhuan
    Wang, Xingxing
    SENSORS, 2024, 24 (12)