A novel method for semi-automatic 2D to 3D video conversion

被引:15
|
作者
Wu, Chenglei [1 ]
Er, Guihua [1 ]
Xie, Xudong [1 ]
Li, Tao [1 ]
Cao, Xun [1 ]
Dai, Qionghai [1 ]
机构
[1] Tsinghua Univ, Broadband Networks & Digital Media Lab, Dept Automat, Beijing, Peoples R China
关键词
three-dimensional displays; image segmentation; stereo vision;
D O I
10.1109/3DTV.2008.4547809
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we present a novel semi-automatic method for converting monoscopic video to stereoscopic video. An efficient interactive image cutout tool is first used to segment the object-of-interest in the key frames. Then, we assign the initial depth information to the segmented objects. These objects are tracked in the whole video sequence through a bi-directional KLT (Kanade-Lucas-Tomashi) algorithm. In addition, depth interpolation is employed to produce the depth information in the non-key frames. Finally, stereoscopic video is synthesized in consideration of different 3D display types. The experimental results show that our method can fulfill 2D to 3D video conversion both reliably and efficiently.
引用
收藏
页码:45 / 48
页数:4
相关论文
共 50 条
  • [1] A Simple Semi-automatic Technique for 2D to 3D Video Conversion
    Chen, Jun
    Zhao, Jianhui
    Wang, Xiaomao
    Huang, Chuanhe
    Dong, Erqian
    Chen, Bingyu
    Yuan, Zhiyong
    [J]. ARTIFICIAL INTELLIGENCE AND COMPUTATIONAL INTELLIGENCE, PT II, 2011, 7003 : 336 - 343
  • [2] Depth propagation for semi-automatic 2D to 3D conversion
    Tolstaya, Ekaterina
    Pohl, Petr
    Rychagov, Michael
    [J]. THREE-DIMENSIONAL IMAGE PROCESSING, MEASUREMENT (3DIPM), AND APPLICATIONS 2015, 2015, 9393
  • [3] A Semi-Automatic 2D to Stereoscopic 3D Image and Video Conversion System in a Semi-Automated Segmentation Perspective
    Phan, Raymond
    Androutsos, Dimitrios
    [J]. STEREOSCOPIC DISPLAYS AND APPLICATIONS XXIV, 2013, 8648
  • [4] A Novel Key-Frame Extraction Method for Semi-Automatic 2D-to-3D Video Conversion
    Wang, Dichangsheng
    Liu, Ju
    Sun, Jiande
    Liu, Wei
    Li, Yujun
    [J]. 2012 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB), 2012,
  • [5] Robust Semi-Automatic Depth Map Generation in Unconstrained Images and Video Sequences for 2D to Stereoscopic 3D Conversion
    Phan, Raymond
    Androutsos, Dimitrios
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2014, 16 (01) : 122 - 136
  • [6] Foreground Depth Estimation for Semi-automatic 2D-to-3D Video Conversion
    Lie, Wen-Nung
    Chen, Yi-Kai
    Chiang, Jui-Chiu
    [J]. 2018 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2018, : 1077 - 1081
  • [7] AUTOMATIC 2D TO STEREOSCOPIC VIDEO CONVERSION FOR 3D TVS
    Zhou, Xichen
    Desai, Bipin C.
    Poullis, Charalambos
    [J]. 2017 3DTV CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO (3DTV-CON), 2017,
  • [8] Semi-automatic 2D-to-3D Video Conversion Based on Background Sprite Generation
    Lie, Wen-Nung
    Chiu, Shao-Ting
    Chiang, Jui-Chiu
    [J]. 2016 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA), 2016,
  • [9] Semi-automatic 2D-to-3D video conversion based on background sprite generation
    Lie, Wen-Nung
    Chiu, Shao-Ting
    Chen, Yi-Kai
    Chiang, Jui-Chiu
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2020, 70
  • [10] SEMI-AUTOMATIC 2D TO 3D IMAGE CONVERSION USING A HYBRID RANDOMWALKS AND GRAPH CUTS BASED APPROACH
    Phan, Raymond
    Rzeszutek, Richard
    Androutsos, Dimitrios
    [J]. 2011 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2011, : 897 - 900