Predictive and Adaptive Deep Coding for Wireless Image Transmission in Semantic Communication

被引:11
|
作者
Zhang, Wenyu [1 ]
Zhang, Haijun [2 ,3 ]
Ma, Hui [1 ]
Shao, Hua [1 ]
Wang, Ning [4 ]
Leung, Victor C. M. [5 ,6 ]
机构
[1] Univ Sci & Technol Beijing, Inst Artificial Intelligence, Sch Intelligence Sci & Technol, Beijing 100083, Peoples R China
[2] Univ Sci & Technol Beijing, Beijing Adv Innovat Ctr Mat Genome Engn, Beijing, Peoples R China
[3] Univ Sci & Technol Beijing, Beijing Engn & Technol Res Ctr Convergence Network, Beijing, Peoples R China
[4] Zhengzhou Univ, Sch Informat Engn, Henan Joint Int Res Lab Intelligent Networking & D, Zhengzhou 450001, Henan, Peoples R China
[5] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
[6] Univ British Columbia, Dept Elect & Comp Engn, Vancouver, BC V6T 1Z4, Canada
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Adaptive code length; joint source channel coding; quality prediction; semantic communication; wireless image transmission;
D O I
10.1109/TWC.2023.3234408
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Semantic communication is a newly emerged communication paradigm that exploits deep learning (DL) models to realize communication processes like source coding and channel coding. Recent advances have demonstrated that DL-based joint source-channel coding (DeepJSCC) can achieve exciting data compression and noise-resiliency performances for wireless image transmission tasks, especially in environments with low channel signal-to-noises (SNRs). However, existing DeepJSCC-based semantic communication frameworks still cannot achieve adaptive code rates for different channel SNRs and image contents, which reduces its flexibility and bandwidth efficiency. In this paper, we propose a predictive and adaptive deep coding (PADC) framework for realizing flexible code rate optimization with a given target transmission quality requirement. PADC is realized by a variable code length enabled DeepJSCC (DeepJSCC-V) model for realizing flexible code length adjustment, an Oracle Network (OraNet) model for predicting peak-signal-to-noise (PSNR) value for an image transmission task according to its contents, channel signal to noise ratio (SNR) and the compression ratio (CR) value, and a CR optimizer aims at finding the minimal data-level or instance-level CR with a PSNR quality constraint. By using the above three modules, PADC can transmit the image data with minimal CR, which greatly increases bandwidth efficiency. Simulation results demonstrate that the proposed DeepJSCC-V model can achieve similar PSNR performances compared with the state-of-the-art Attention-based DeepJSCC (ADJSCC) model, and the proposed OraNet model is able to predict high-quality PSNR values with an average error lower than 0.5dB. Results also demonstrate that the proposed PADC can use nearly minimal bandwidth consumption for wireless image transmission tasks with different channel SNR and image contents, at the same time guaranteeing the PSNR constraint for each image data.
引用
收藏
页码:5486 / 5501
页数:16
相关论文
共 50 条
  • [1] Deep Semantic Coding for Wireless Image Retrieval
    Wang, Ying
    Qi, Chenhao
    2022 IEEE 96TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-FALL), 2022,
  • [2] Adaptive nonlinear deep coding using hybrid attention for wireless image transmission
    Chao Li
    Yangling Zeng
    Zhiwei Ye
    Qin Peng
    Yu Sun
    Chen Wang
    Signal, Image and Video Processing, 2025, 19 (3)
  • [3] Deep Joint Source-Channel Coding for Wireless Image Transmission with Semantic Importance
    Sun, Qizheng
    Guo, Caili
    Yang, Yang
    Chen, Jiujiu
    Tang, Rui
    Liu, Chuanhong
    2022 IEEE 96TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-FALL), 2022,
  • [4] Deep Joint Source-Channel Coding for Wireless Image Transmission with Adaptive Models
    Song, Mengshu
    Ma, Nan
    Dong, Chen
    Xu, Xiaodong
    Zhang, Ping
    ELECTRONICS, 2023, 12 (22)
  • [5] DeepMA: End-to-End Deep Multiple Access for Wireless Image Transmission in Semantic Communication
    Zhang, Wenyu
    Bai, Kaiyuan
    Zeadally, Sherali
    Zhang, Haijun
    Shao, Hua
    Ma, Hui
    Leung, Victor C. M.
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2024, 10 (02) : 387 - 402
  • [6] Contrastive Learning based Semantic Communication for Wireless Image Transmission
    Tang, Shunpu
    Yang, Qianqian
    Fan, Lisheng
    Lei, Xianfu
    Deng, Yansha
    Nallanathan, Arumugam
    2023 IEEE 98TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-FALL, 2023,
  • [7] DEEP JOINT SOURCE-CHANNEL CODING FOR WIRELESS IMAGE TRANSMISSION WITH ADAPTIVE RATE CONTROL
    Yang, Mingyu
    Kim, Hun-Seok
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 5193 - 5197
  • [8] SNR-ADAPTIVE DEEP JOINT SOURCE-CHANNEL CODING FOR WIRELESS IMAGE TRANSMISSION
    Ding, Mingze
    Li, Jiahui
    Ma, Mengyao
    Fan, Xiaopeng
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1555 - 1559
  • [9] Adaptive FEC coding and cooperative relayed wireless image transmission
    Xu, Hansong
    Hua, Kun
    Wang, Honggang
    DIGITAL COMMUNICATIONS AND NETWORKS, 2015, 1 (03) : 213 - 221
  • [10] Adaptive FEC coding and cooperative relayed wireless image transmission
    Hansong Xu
    Kun Hua
    Honggang Wang
    Digital Communications and Networks, 2015, 1 (03) : 213 - 221