Indoor and outdoor depth imaging of leaves with time-of-flight and stereo vision sensors: Analysis and comparison

被引:89
|
作者
Kazmi, Wajahat [1 ]
Foix, Sergi [2 ]
Alenya, Guillem [2 ]
Andersen, Hans Jorgen [1 ]
机构
[1] Aalborg Univ, Dept Architecture Design & Media Technol, DK-9200 Aalborg, Denmark
[2] CSIC UPC, Inst Robbt & Informat Ind, Barcelona 08028, Spain
关键词
Leaf imaging; Depth; Exposure; Time-of-Flight; Stereo vision; Sunlight; RECONSTRUCTION; LIGHT; MODEL; CANOPIES; SYSTEM; PLANTS; COLOR;
D O I
10.1016/j.isprsjprs.2013.11.012
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
In this article we analyze the response of Time-of-Flight (ToF) cameras (active sensors) for close range imaging under three different illumination conditions and compare the results with stereo vision (passive) sensors. ToF cameras are sensitive to ambient light and have low resolution but deliver high frame rate accurate depth data under suitable conditions. We introduce metrics for performance evaluation over a small region of interest. Based on these metrics, we analyze and compare depth imaging of leaf under indoor (room) and outdoor (shadow and sunlight) conditions by varying exposure times of the sensors. Performance of three different ToF cameras (PMD CamBoard, PMD CamCube and SwissRanger SR4000) is compared against selected stereo-correspondence algorithms (local correlation and graph cuts). PMD CamCube has better cancelation of sunlight, followed by CamBoard, while SwissRanger SR4000 performs poorly under sunlight. Stereo vision is comparatively more robust to ambient illumination and provides high resolution depth data but is constrained by texture of the object along with computational efficiency. Graph cut based stereo correspondence algorithm can better retrieve the shape of the leaves but is computationally much more expensive as compared to local correlation. Finally, we propose a method to increase the dynamic range of ToF cameras for a scene involving both shadow and sunlight exposures at the same time by taking advantage of camera flags (PMD) or confidence matrix (SwissRanger). (C) 2013 International Society for Photogrammetly and Remote Sensing, Inc. (ISPRS) Published by Elsevier B.V. All rights reserved.
引用
收藏
页码:128 / 146
页数:19
相关论文
共 50 条
  • [1] Depth Imaging by Combining Time-of-Flight and On-Demand Stereo
    Hahne, Uwe
    Alexa, Marc
    [J]. DYNAMIC 3D IMAGING, PROCEEDINGS, 2009, 5742 : 70 - 83
  • [2] Visual Discomfort Visualizer using Stereo Vision and Time-of-Flight Depth Cameras
    Jung, Yong Ju
    Sohn, Hosik
    Ro, Yong Man
    [J]. IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2012, 58 (02) : 246 - 254
  • [3] Error correction of depth images for multiview time-of-flight vision sensors
    He, Yu
    Chen, Shengyong
    [J]. INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2020, 17 (04):
  • [4] Occluded Imaging with Time-of-Flight Sensors
    Kadambi, Achuta
    Zhao, Hang
    Shi, Boxin
    Raskar, Ramesh
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2016, 35 (02):
  • [5] Fusion of time-of-flight depth and stereo for high accuracy depth maps
    Zhu, Jiejie
    Wang, Liang
    Yang, Ruigang
    Davis, James
    [J]. 2008 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-12, 2008, : 3262 - +
  • [6] Live Demonstration: Multiple-Path Depth Imaging with Time-of-Flight Sensors
    Conde, Miguel Heredia
    Bhandari, Ayush
    Kerstein, Thomas
    Buxbaum, Bernd
    Loffeld, Otmar
    [J]. 2019 IEEE SENSORS, 2019,
  • [7] Time-of-Flight Depth Datasets for Indoor Semantic SLAM
    Ghorpade, Vijaya K.
    Borrmann, Dorit
    Checchin, Paul
    Malaterre, Laurent
    Trassoudaine, Laurent
    [J]. ROBOTICS RESEARCH, 2020, 10 : 679 - 693
  • [8] Guided optimization framework for the fusion of time-of-flight with stereo depth
    Zakeri, Faezeh Sadat
    Sjostrom, Marten
    Keinert, Joachim
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2020, 29 (05)
  • [9] Combination of Time-of-Flight Depth and Stereo using Semiglobal Optimization
    Fischer, Jan
    Arbeiter, Georg
    Verl, Alexander
    [J]. 2011 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2011,
  • [10] Fast sensors for time-of-flight imaging applications
    Vallance, Claire
    Brouard, Mark
    Lauer, Alexandra
    Slater, Craig S.
    Halford, Edward
    Winter, Benjamin
    King, Simon J.
    Lee, Jason W. L.
    Pooley, Daniel E.
    Sedgwick, Iain
    Turchetta, Renato
    Nomerotski, Andrei
    John, Jaya John
    Hill, Laura
    [J]. PHYSICAL CHEMISTRY CHEMICAL PHYSICS, 2014, 16 (02) : 383 - 395