Moving Cast Shadows Segmentation Using Illumination Invariant Feature

被引:15
|
作者
Wang, Bingshu [1 ]
Zhao, Yong [2 ]
Philip Chen, C. L. [3 ,4 ]
机构
[1] Univ Macau, Dept Comp & Informat Sci, Fac Sci & Technol, Macau 999078, Peoples R China
[2] Peking Univ, Shenzhen Grad Sch, Key Lab Integrated Microsyst, Sch Elect & Comp Engn, Shenzhen 518055, Peoples R China
[3] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510641, Peoples R China
[4] Univ Macau, Fac Sci & Technol, Macau 999078, Peoples R China
基金
中国国家自然科学基金;
关键词
Lighting; Estimation; Color; Video sequences; Image color analysis; Feature extraction; Distribution functions; Moving shadows segmentation; bidirectional reflectance distribution function; illumination invariant; shadow direction features;
D O I
10.1109/TMM.2019.2954752
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents an effective framework for removing moving cast shadows. Taking the reflection property of object surface for shadow regions under static and fixed scenes, an approximation estimation strategy of bidirectional reflectance distribution function as illumination invariant feature is proposed. It is valid for different types of shadow scenes. In this paper, we propose a new multiple ratios-based technique to justify shadow type for each frame: intensity ratio, area ratio and edge ratio of shadow regions are introduced. According to shadow types, several specified strategies are designed. For weak shadows, multiple features fusion strategy is employed, including color constancy, texture consistency and illumination invariant. For strong shadows, illumination invariant is utilized to detect the umbra and color constancy is utilized to detect the penumbra. Moreover, a suite of shadow direction features is firstly proposed to identify penumbra. The proposed approach is verified in fourteen video sequences varying from weak to strong shadows. The experimental results demonstrate the effectiveness and robustness of the proposed method for both indoor and outdoor scenes compared with some state-of-the-art approaches.
引用
收藏
页码:2221 / 2233
页数:13
相关论文
共 50 条
  • [1] Detection of Moving Cast Shadows for Object Segmentation
    Stauder, Juergen
    Mech, Roland
    Ostermann, Joern
    IEEE TRANSACTIONS ON MULTIMEDIA, 1999, 1 (01) : 65 - 76
  • [2] HARD SHADOWS REMOVAL USING AN APPROXIMATE ILLUMINATION INVARIANT
    Wang, Bingshu
    Chen, C. L. Philip
    Li, Yuyuan
    Zhao, Yong
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 1628 - 1632
  • [3] Object segmentation and feature estimation using shadows
    Salberg, AB
    Harbitz, A
    PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 3, 2004, : 674 - 678
  • [4] Simultaneous Cast Shadows, Illumination and Geometry Inference Using Hypergraphs
    Panagopoulos, Alexandros
    Wang, Chaohui
    Samaras, Dimitris
    Paragios, Nikos
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (02) : 437 - 449
  • [5] Moving cast shadows detection using ratio edge
    Zhang, Wei
    Zhon-Fang, Xiang
    Yang, Xiaokang K.
    Wu, Q. M. Jonathan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2007, 9 (06) : 1202 - 1214
  • [6] Detection of Moving Cast Shadows Using Edge Information
    Panicker, Vinitha J.
    Wilscy, M.
    2010 2ND INTERNATIONAL CONFERENCE ON COMPUTER AND AUTOMATION ENGINEERING (ICCAE 2010), VOL 5, 2010, : 817 - 821
  • [7] Joint moving cast shadows segmentation and light source detection in video sequences
    Nicolas, H
    Pinel, JM
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2006, 21 (01) : 22 - 43
  • [8] Robust Watershed Segmentation of Moving Shadows using Wavelets
    ShabaniNia, Elham
    Naghsh-Nilchi, Ahmad Reza
    2013 8TH IRANIAN CONFERENCE ON MACHINE VISION & IMAGE PROCESSING (MVIP 2013), 2013, : 381 - 386
  • [9] Illumination Estimation using Cast Shadows for Realistic Augmented Reality Applications
    Jiddi, Salma
    Robert, Philippe
    Marchand, Eric
    ADJUNCT PROCEEDINGS OF THE 2017 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR-ADJUNCT), 2017, : 192 - 193
  • [10] Detection of moving cast shadows using image orthogonal transform
    Zhang, Wei
    Fang, Xiang Zhong
    Xu, Yi
    18TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2006, : 626 - +