Learn codes: Inventing low-latency codes via recurrent neural networks

被引:22
|
作者
Jiang, Yihan [1 ]
Kim, Hyeji [2 ]
Asnani, Himanshu [3 ]
Kannan, Sreeram [1 ]
Oh, Sewoong [4 ]
Viswanath, Pramod [5 ,6 ]
机构
[1] The Department of Electrical and Computer Engineering, University of Washington, Seattle,WA,98195, United States
[2] Samsung AI Center Cambridge, Cambridge,CB1 2JD, United Kingdom
[3] The School of Technology and Computer Science, Tata Institute of Fundamental Research, Mumbai,400005, India
[4] The Allen School of Computer Science Engineering, University of Washington, Seattle,WA,98195, United States
[5] The Coordinated Science Laboratory, University of Illinois at Urbana–Champaign, Champaign,IL,61801, United States
[6] The Department of Electrical Engineering, University of Illinois at Urbana–Champaign, Champaign,IL,61801, United States
基金
美国国家科学基金会;
关键词
5G mobile communication systems - Asymptotic analysis - Channel coding - Convolution - Convolutional codes - Decoding - Gaussian noise (electronic) - Network coding - White noise;
D O I
10.1109/JSAIT.2020.2988577
中图分类号
学科分类号
摘要
Designing channel codes under low-latency constraints is one of the most demanding requirements in 5G standards. However, a sharp characterization of the performance of traditional codes is available only in the large block-length limit. Guided by such asymptotic analysis, code designs require large block lengths as well as latency to achieve the desired error rate. Tail-biting convolutional codes and other recent state-of-the-art short block codes, while promising reduced latency, are neither robust to channel-mismatch nor adaptive to varying channel conditions. When the codes designed for one channel (e.g., Additive White Gaussian Noise (AWGN) channel) are used for another (e.g., non-AWGN channels), heuristics are necessary to achieve non-trivial performance. In this paper, we first propose an end-to-end learned neural code, obtained by jointly designing a Recurrent Neural Network (RNN) based encoder and decoder. This code outperforms canonical convolutional code under block settings. We then leverage this experience to propose a new class of codes under low-latency constraints, which we call Low-latency Efficient Adaptive Robust Neural (LEARN) codes. These codes outperform state-of-the-art low-latency codes and exhibit robustness and adaptivity properties. LEARN codes show the potential to design new versatile and universal codes for future communications via tools of modern deep learning coupled with communication engineering insights. © 2020 IEEE.
引用
收藏
页码:207 / 216
相关论文
共 50 条
  • [1] LEARN Codes: Inventing low-latency codes via recurrent neural networks
    Jiang, Yihan
    Kim, Hyeji
    Asnani, Himanshu
    Kannan, Sreeram
    Oh, Sewoong
    Viswanath, Pramod
    [J]. ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,
  • [2] A low-latency list decoder for polar codes
    Qingyun Xu
    Zhiwen Pan
    Nan Liu
    Xiaohu You
    [J]. Science China Information Sciences, 2018, 61
  • [3] Low-latency decoding of EG LDPC codes
    Zhang, Juntan
    Yedidia, Jonathan S.
    Fossorier, Marc P. C.
    [J]. JOURNAL OF LIGHTWAVE TECHNOLOGY, 2007, 25 (09) : 2879 - 2886
  • [4] A low-latency list decoder for polar codes
    Xu, Qingyun
    Pan, Zhiwen
    Liu, Nan
    You, Xiaohu
    [J]. SCIENCE CHINA-INFORMATION SCIENCES, 2018, 61 (10)
  • [5] A low-latency list decoder for polar codes
    Qingyun XU
    Zhiwen PAN
    Nan LIU
    Xiaohu YOU
    [J]. Science China(Information Sciences), 2018, 61 (10) : 163 - 172
  • [6] Low-Latency Low-Overhead Zipper Codes
    Karimi, Bashirreza
    Barakatain, Masoud
    Hashemi, Yoones
    Chang, Deyuan
    Ebrahimzad, Hamid
    Li, Chuandong
    [J]. 2022 EUROPEAN CONFERENCE ON OPTICAL COMMUNICATION (ECOC), 2022,
  • [7] Low-Latency Neural Decoders for Linear and Non-Linear Block Codes
    Leung, Cheuk Ting
    Bhat, Rajshekhar V.
    Motani, Mehul
    [J]. 2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [8] A Low-Latency Algorithm for Stochastic Decoding of LDPC Codes
    Huang, Kuo-Lun
    Gaudet, Vincent C.
    Salehi, Masoud
    [J]. 2015 53RD ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2015, : 1510 - 1515
  • [9] Simple Streaming Codes for Reliable, Low-Latency Communication
    Krishnan, M. Krishnan
    Ramkumar, Vinayak
    Vajha, Myna
    Kumar, P. Vijay
    [J]. IEEE COMMUNICATIONS LETTERS, 2020, 24 (02) : 249 - 253
  • [10] Low-Latency Ordered Statistics Decoding of BCH Codes
    Yang, Lijia
    Chen, Li
    [J]. 2022 IEEE INFORMATION THEORY WORKSHOP (ITW), 2022, : 404 - 409