Structure from Motion and Photometric Stereo for Dense 3D Shape Recovery

被引:0
|
作者
Sabzevari, Reza [1 ]
Del Bue, Alessio [1 ]
Murino, Vittorio [1 ]
机构
[1] Ist Italiano Tecnol, I-16163 Genoa, Italy
关键词
Structure from Motion; Photometric Stereo; Dense 3D Reconstruction;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we present a dense 3D reconstruction pipeline from monocular video sequences using jointly Photometric Stereo (PS) and Structure from Motion (SfM) approaches. The input videos are completely uncalibrated both from the multi-view geometry and photometric stereo aspects. In particular we make use of the 3D metric information computed with SfM from a set of 2D landmarks in order to solve for the bas-relief ambiguity which is intrinsic from dense PS surface estimation. The algorithm is evaluated over the CMU Multi-Pie database which contains the images of 337 subjects viewed under different lighting conditions and showing various facial expressions.
引用
收藏
页码:660 / 669
页数:10
相关论文
共 50 条
  • [1] A variational method for the recovery of dense 3D structure from motion
    Sekkati, Hicham
    Mitiche, Amar
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2007, 55 (07) : 597 - 607
  • [2] Estimating 3D shape from the optical flow of photometric stereo images
    Torreao, JRA
    PROGRESS IN ARTIFICIAL INTELLIGENCE-IBERAMIA 98, 1998, 1484 : 253 - 261
  • [3] Microscopic Photometric Stereo: A Dense Microstructure 3D Measurement Method
    Li, Zhongwei
    Li, Y. F.
    2011 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2011,
  • [4] Investigation of photometric stereo method for 3-D shape recovery from underwater imagery
    Negahdaripour, S
    Zhang, H
    Han, X
    OCEANS 2002 MTS/IEEE CONFERENCE & EXHIBITION, VOLS 1-4, CONFERENCE PROCEEDINGS, 2002, : 1010 - 1017
  • [5] Direct Shape Recovery from Photometric Stereo with Shadows
    Mecca, Roberto
    Wetzler, Aaron
    Kimmel, Ron
    Bruckstein, Alfred Marcel
    2013 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2013), 2013, : 382 - 389
  • [6] Shape and motion under varying illumination: Unifying structure from motion, photometric stereo, and multi-view stereo
    Zhang, L
    Curless, B
    Hertzmann, A
    Seitz, SM
    NINTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS I AND II, PROCEEDINGS, 2003, : 618 - 625
  • [7] 3D shape recovery with registration assisted stereo matching
    Lin, Huei-Yung
    Liang, Sung-Chung
    Wu, Jing-Ren
    PATTERN RECOGNITION AND IMAGE ANALYSIS, PT 2, PROCEEDINGS, 2007, 4478 : 596 - +
  • [8] Quasi-dense motion stereo for 3D view morphing
    Jelinek, D
    Taylor, CJ
    VIRTUAL AND AUGMENTED ARCHITECTURE (VAA'01), 2001, : 219 - 229
  • [9] Mobile photometric stereo with keypoint-based SLAM for dense 3D reconstruction
    Maxence, Remy
    Uchiyama, Hideaki
    Kawasaki, Hiroshi
    Thomas, Diego
    Nozick, Vincent
    Saito, Hideo
    2019 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2019), 2019, : 574 - 582
  • [10] Integration of defocus and focus analysis with stereo for 3D shape recovery
    Subbarao, M
    Yuan, T
    Tyan, JK
    THREE-DIMENSIONAL IMAGING AND LASER-BASED SYSTEMS FOR METROLOGY AND INSPECTION III, 1997, 3204 : 11 - 23