Fast Depth Video Compression for Mobile RGB-D Sensors

被引:13
|
作者
Wang, Xiaoqin [1 ]
Sekercioglu, Yasar Ahmet [1 ]
Drummond, Tom [1 ]
Natalizio, Enrico [2 ]
Fantoni, Isabelle [2 ]
Fremont, Vincent [2 ]
机构
[1] Monash Univ, ARC Ctr Excellence Robot Vis, Melbourne, Vic 3800, Australia
[2] Univ Technol Compiegne, Heudiasyc Lab, F-60200 Compiegne, France
基金
澳大利亚研究理事会;
关键词
Depth map; depth video coding; inter-frame correlation; motion compensation; MOTION ESTIMATION;
D O I
10.1109/TCSVT.2015.2416571
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We propose a new method, called 3-D image warping-based depth video compression (IW-DVC), for fast and efficient compression of depth images captured by mobile RGB-D sensors. The emergence of low-cost RGB-D sensors has created opportunities to find new solutions for a number of computer vision and networked robotics problems, such as 3-D map building, immersive telepresence, or remote sensing. However, efficient transmission and storage of depth data still presents a challenging task to the research community in these applications. Image/video compression has been comprehensively studied and several methods have already been developed. However, these methods result in unacceptably suboptimal outcomes when applied to the depth images. We have designed the IW-DVC method to exploit the special properties of the depth data to achieve a high compression ratio while preserving the quality of the captured depth images. Our solution combines the egomotion estimation and 3-D image warping techniques and includes a lossless coding scheme that is capable of adapting to depth data with a high dynamic range. IW-DVC operates at a high speed, suitable for real-time applications, and is able to attain an enhanced motion compensation accuracy compared with the conventional approaches. In addition, it removes the existing redundant information between the depth frames to further increase compression efficiency. Our experiments show that IW-DVC attains a very high performance yielding significant compression ratios without sacrificing image quality.
引用
收藏
页码:673 / 686
页数:14
相关论文
共 50 条
  • [31] RGB×D: Learning depth-weighted RGB patches for RGB-D indoor semantic segmentation
    Cao, Jinming
    Leng, Hanchao
    Cohen-Or, Daniel
    Lischinski, Dani
    Chen, Ying
    Tu, Changhe
    Li, Yangyan
    [J]. Neurocomputing, 2021, 462 : 568 - 580
  • [32] Shape Preserving RGB-D Depth Map Restoration
    Liu, Wei
    Xue, Haoyang
    Gu, Yun
    Yang, Jie
    Wu, Qiang
    Jia, Zhenhong
    [J]. NEURAL INFORMATION PROCESSING, ICONIP 2014, PT III, 2014, 8836 : 150 - 158
  • [33] Genetic Algorithm for Depth Images in RGB-D Cameras
    Danciu, Gabriel
    Szekely, Iuliu
    [J]. 2014 IEEE 20TH INTERNATIONAL SYMPOSIUM FOR DESIGN AND TECHNOLOGY IN ELECTRONIC PACKAGING (SIITME), 2014, : 233 - 238
  • [34] DEPTH ENHANCEMENT USING RGB-D GUIDED FILTERING
    Hui, Tak-Wai
    Ngan, King Ngi
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 3832 - 3836
  • [35] Deep RGB-D Saliency Detection Without Depth
    Zhang, Yuan-fang
    Zheng, Jiangbin
    Jia, Wenjing
    Huang, Wenfeng
    Li, Long
    Liu, Nian
    Li, Fei
    He, Xiangjian
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 755 - 767
  • [36] Deep Depth Completion of a Single RGB-D Image
    Zhang, Yinda
    Funkhouser, Thomas
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 175 - 185
  • [37] Depth-Aware CNN for RGB-D Segmentation
    Wang, Weiyue
    Neumann, Ulrich
    [J]. COMPUTER VISION - ECCV 2018, PT XI, 2018, 11215 : 144 - 161
  • [38] DEPTH REMOVAL DISTILLATION FOR RGB-D SEMANTIC SEGMENTATION
    Fang, Tiyu
    Liang, Zhen
    Shao, Xiuli
    Dong, Zihao
    Li, Jinping
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2405 - 2409
  • [39] Depth Refinement for Binocular Kinect RGB-D Cameras
    Bai, Jinghui
    Yang, Jingyu
    Ye, Xinchen
    Hou, Chunping
    [J]. 2016 30TH ANNIVERSARY OF VISUAL COMMUNICATION AND IMAGE PROCESSING (VCIP), 2016,
  • [40] A New Calibration Method for Commercial RGB-D Sensors
    Darwish, Walid
    Tang, Shenjun
    Li, Wenbin
    Chen, Wu
    [J]. SENSORS, 2017, 17 (06)