JET: Joint source and channel coding for error resilient virtual reality video wireless transmission

被引:28
|
作者
Liu, Zhi [1 ]
Ishihara, Susumu [1 ]
Cui, Ying [2 ]
Ji, Yusheng [3 ]
Tanaka, Yoshiaki [4 ]
机构
[1] Shizuoka Univ, 3-5-1 Johoku, Hamamatsu, Shizuoka 4328561, Japan
[2] Shanghai Jiao Tong Univ, 800 Dongchuan Rd, Minhang Qu 200240, Peoples R China
[3] Natl Inst Informat, Chiyoda Ku, 2-1-2 Hitotsubashi, Tokyo 1018430, Japan
[4] Waseda Univ, Shinjuku Ku, 3-4-1 Okubo, Tokyo 1698555, Japan
关键词
Virtual reality; VR; 360; video; Source and channel coding; Video streaming; Error resilient;
D O I
10.1016/j.sigpro.2018.01.009
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Virtual reality (VR) provides users extraordinary viewing experience and draws more and more attentions from both industry and academia. In this paper, we propose JET: Joint source and channel coding for Error resilient virtual reality video wireless Transmission, where we jointly investigate how to conquer the problem of source video's huge size, how to efficiently satisfy a user's view switch request and how to handle packet loss. Specifically, we first divide a VR video into smaller video tiles. Upon a user's view switch request, the tiles corresponding to the part that the user is requesting, referred to as the field of view (FoV), and the part that the user may switch to before new video can be received, are delivered over a wireless network. We consider unequal error protection (UEP) for FoV and the rest part and formulate the inherent error resilient VR video transmission problem into a joint source and channel coding problem. In particular, we optimize the tile partition, quantization parameter and Forward Error Correction (FEC) packet allocation to maximize a user's received video quality. We also propose a low-complexity heuristic algorithm to solve this optimization problem. Extensive simulations are conducted and simulation results verify the superior performance. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:154 / 162
页数:9
相关论文
共 50 条
  • [1] Joint optimization of source coding, channel coding and error concealment for wireless video transmission
    Su, YJ
    Wang, J
    Chen, JS
    Lu, JH
    ADVANCED SIGNAL PROCESSING ALGORITHMS, ARCHITECTURES, AND IMPLEMENTATIONS XI, 2001, 4474 : 429 - 437
  • [2] Error Resilient Joint Source-Channel Adaptive Intra-Refresh Rate for Wireless Video Transmission
    dela Cruz, Angelo R.
    Cajote, Rhandley D.
    2014 19TH INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP), 2014, : 509 - 514
  • [3] Joint source-channel coding for highly efficient error resilient image transmission
    Vass, J
    Zhuang, XH
    ISCAS 2000: IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS - PROCEEDINGS, VOL III: EMERGING TECHNOLOGIES FOR THE 21ST CENTURY, 2000, : 311 - 314
  • [4] Joint source coding and channel estimation for video transmission over wireless LAN
    Li Xiaofei
    Mei Zhonghui
    2008 4TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING, VOLS 1-31, 2008, : 3288 - 3291
  • [5] Source-channel prediction in error resilient video coding
    Yang, H
    Rose, K
    2003 INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOL II, PROCEEDINGS, 2003, : 233 - 236
  • [6] On video communications in MIMO systems: Channel coding and error resilient source coding
    Lin, S
    Stefanov, A
    Wang, Y
    2003 4TH IEEE WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS - SPAWC 2003, 2004, : 653 - 657
  • [7] Cooperative source and channel coding for wireless video transmission
    Shutoy, Hoi Yin
    Wang, Yao
    Erkip, Elza
    2006 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP 2006, PROCEEDINGS, 2006, : 713 - +
  • [8] A joint source channel coding strategy for video transmission
    Perrine, C.
    Chatelllier, C.
    Wang, S.
    Olivier, C.
    2008 3RD INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGIES: FROM THEORY TO APPLICATIONS, VOLS 1-5, 2008, : 1033 - 1037
  • [9] Adaptive segmentation based joint source-channel coding for wireless video transmission
    Su, YJ
    Lu, JH
    Wang, J
    Letaief, KB
    Gu, J
    IEEE VTC 53RD VEHICULAR TECHNOLOGY CONFERENCE, SPRING 2001, VOLS 1-4, PROCEEDINGS, 2001, : 2076 - 2080
  • [10] ROI-based joint source-channel coding for wireless video transmission
    Zhang, ZM
    Zhu, GX
    Wang, F
    Xie, L
    8TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY, VOLS 1-3: TOWARD THE ERA OF UBIQUITOUS NETWORKS AND SOCIETIES, 2006, : U923 - U926