SNR-adaptive deep joint source-channel coding scheme for image semantic transmission with convolutional block attention module

被引:0
|
作者
Yang Yujia
Liu Yiming
Zhang Wenjia
Zhang Zhi
机构
[1] Beijing University of Posts and Telecommunications
[2] State Key Laboratory of Networking and Switch Technology
基金
中国国家自然科学基金; 中央高校基本科研业务费专项资金资助;
关键词
D O I
10.19682/j.cnki.1005-8885.2024.2001
中图分类号
TN911.2 [信息论]; TP18 [人工智能理论];
学科分类号
070104 ; 081101 ; 081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the development of deep learning(DL), joint source-channel coding(JSCC) solutions for end-to-end transmission have gained a lot of attention. Adaptive deep JSCC schemes support dynamically adjusting the rate according to different channel conditions during transmission, enhancing robustness in dynamic wireless environment. However, most of the existing adaptive JSCC schemes only consider different channel conditions, ignoring the different feature importance in the image processing and transmission. The uniform compression of different features in the image may result in the compromise of critical image details, particularly in low signal-to-noise ratio(SNR) scenarios. To address the above issues, in this paper, a dual attention mechanism is introduced and an SNR-adaptive deep JSCC mechanism with a convolutional block attention module(CBAM) is proposed, in which matrix operations are applied to features in spatial and channel dimensions respectively. The proposed solution concatenates the pooling feature with the SNR level and passes it sequentially through the channel attention network and spatial attention network to obtain the importance evaluation result. Experiments show that the proposed solution outperforms other baseline schemes in terms of peak SNR(PSNR) and structural similarity(SSIM), particularly in low SNR scenarios or when dealing with complex image content.
引用
收藏
页码:1 / 11
页数:11
相关论文
共 50 条
  • [1] SNR-adaptive deep joint source-channel coding scheme for image semantic transmission with convolutional block attention module
    Yujia Y.
    Yiming L.
    Wenjia Z.
    Zhi Z.
    Journal of China Universities of Posts and Telecommunications, 2024, 31 (01): : 1 - 11
  • [2] SNR-ADAPTIVE DEEP JOINT SOURCE-CHANNEL CODING FOR WIRELESS IMAGE TRANSMISSION
    Ding, Mingze
    Li, Jiahui
    Ma, Mengyao
    Fan, Xiaopeng
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1555 - 1559
  • [3] Deep Joint Source-Channel Coding for Wireless Image Transmission with Semantic Importance
    Sun, Qizheng
    Guo, Caili
    Yang, Yang
    Chen, Jiujiu
    Tang, Rui
    Liu, Chuanhong
    2022 IEEE 96TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-FALL), 2022,
  • [4] Generative Joint Source-Channel Coding for Semantic Image Transmission
    Erdemir, Ecenaz
    Tung, Tze-Yang
    Dragotti, Pier Luigi
    Gunduz, Deniz
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (08) : 2645 - 2657
  • [5] Deep Joint Source-Channel Coding for Wireless Image Transmission with Adaptive Models
    Song, Mengshu
    Ma, Nan
    Dong, Chen
    Xu, Xiaodong
    Zhang, Ping
    ELECTRONICS, 2023, 12 (22)
  • [6] A joint source-channel coding scheme for robust image transmission
    Chande, V
    Farvardin, N
    DCC '98 - DATA COMPRESSION CONFERENCE, 1998, : 530 - 530
  • [7] Deep Joint Source-Channel Coding for Wireless Image Transmission
    Bourtsoulatze, Eirina
    Kurka, David Burth
    Gunduz, Deniz
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2019, 5 (03) : 567 - 579
  • [8] DEEP JOINT SOURCE-CHANNEL CODING FOR WIRELESS IMAGE TRANSMISSION
    Bourtsoulatze, Eirina
    Kurka, David Burth
    Gunduz, Deniz
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 4774 - 4778
  • [9] Deep Joint Source-Channel Coding for Adaptive Image Transmission Over MIMO Channels
    Wu, Haotian
    Shao, Yulin
    Bian, Chenghong
    Mikolajczyk, Krystian
    Gunduz, Deniz
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (10) : 15002 - 15017
  • [10] DEEP JOINT SOURCE-CHANNEL CODING FOR WIRELESS IMAGE TRANSMISSION WITH ADAPTIVE RATE CONTROL
    Yang, Mingyu
    Kim, Hun-Seok
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 5193 - 5197