Deep Joint Source-Channel Coding for Wireless Image Transmission

被引:373
|
作者
Bourtsoulatze, Eirina [1 ]
Kurka, David Burth [2 ]
Gunduz, Deniz [2 ]
机构
[1] UCL, Dept Elect & Elect Engn, Commun & Informat Syst Grp, London WC1E 7JE, England
[2] Imperial Coll London, Dept Elect & Elect Engn, Informat Proc & Commun Lab, London SW7 2BT, England
基金
欧盟地平线“2020”; 欧洲研究理事会;
关键词
Joint source-channel coding; deep neural networks; image communications;
D O I
10.1109/TCCN.2019.2919300
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
We propose a joint source and channel coding (JSCC) technique for wireless image transmission that does not rely on explicit codes for either compression or error correction; instead, it directly maps the image pixel values to the complex-valued channel input symbols. We parameterize the encoder and decoder functions by two convolutional neural networks (CNNs), which are trained jointly, and can be considered as an autoencoder with a non-trainable layer in the middle that represents the noisy communication channel. Our results show that the proposed deep JSCC scheme outperforms digital transmission concatenating JPEG or JPEG2000 compression with a capacity achieving channel code at low signal-to-noise ratio (SNR) and channel bandwidth values in the presence of additive white Gaussian noise (AWGN). More strikingly, deep JSCC does not suffer from the "cliff effect," and it provides a graceful performance degradation as the channel SNR varies with respect to the SNR value assumed during training. In the case of a slow Rayleigh fading channel, deep JSCC learns noise resilient coded representations and significantly outperforms separation-based digital communication at all SNR and channel bandwidth values.
引用
收藏
页码:567 / 579
页数:13
相关论文
共 50 条
  • [1] DEEP JOINT SOURCE-CHANNEL CODING FOR WIRELESS IMAGE TRANSMISSION
    Bourtsoulatze, Eirina
    Kurka, David Burth
    Gunduz, Deniz
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 4774 - 4778
  • [2] Deep Joint Source-Channel Coding for Wireless Image Transmission with Adaptive Models
    Song, Mengshu
    Ma, Nan
    Dong, Chen
    Xu, Xiaodong
    Zhang, Ping
    [J]. ELECTRONICS, 2023, 12 (22)
  • [3] Deep Joint Source-Channel Coding for Wireless Image Transmission with Semantic Importance
    Sun, Qizheng
    Guo, Caili
    Yang, Yang
    Chen, Jiujiu
    Tang, Rui
    Liu, Chuanhong
    [J]. 2022 IEEE 96TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-FALL), 2022,
  • [4] DEEP JOINT SOURCE-CHANNEL CODING FOR WIRELESS IMAGE RETRIEVAL
    Jankowski, Mikolaj
    Gunduz, Deniz
    Mikolajczyk, Krystian
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 5070 - 5074
  • [5] SNR-ADAPTIVE DEEP JOINT SOURCE-CHANNEL CODING FOR WIRELESS IMAGE TRANSMISSION
    Ding, Mingze
    Li, Jiahui
    Ma, Mengyao
    Fan, Xiaopeng
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1555 - 1559
  • [6] DEEP JOINT SOURCE-CHANNEL CODING FOR WIRELESS IMAGE TRANSMISSION WITH ADAPTIVE RATE CONTROL
    Yang, Mingyu
    Kim, Hun-Seok
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 5193 - 5197
  • [7] Deep Joint Source-Channel Coding Based on Semantics of Pixels for Wireless Image Transmission
    Sun, Qizheng
    Guo, Caili
    Yang, Yang
    Tang, Rui
    Liu, Chuanhong
    [J]. 2023 IEEE 34TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, PIMRC, 2023,
  • [8] Channel-Blind Joint Source-Channel Coding for Wireless Image Transmission
    Yuan, Hongjie
    Xu, Weizhang
    Wang, Yuhuan
    Wang, Xingxing
    [J]. SENSORS, 2024, 24 (12)
  • [9] DISTRIBUTED IMAGE TRANSMISSION USING DEEP JOINT SOURCE-CHANNEL CODING
    Wang, Sixian
    Yang, Ke
    Dai, Jincheng
    Niu, Kai
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 5208 - 5212
  • [10] Deep Joint Source-Channel Coding for Image Transmission With Visual Protection
    Xu, Jialong
    Ai, Bo
    Chen, Wei
    Wang, Ning
    Rodrigues, Miguel
    [J]. IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2023, 9 (06) : 1399 - 1411