Multiple features fusion based video face tracking

被引:6
|
作者
Li, Tianping [1 ,2 ]
Zhou, Pingping [3 ]
Liu, Hui [4 ,5 ]
机构
[1] Shandong Prov Key Lab Med Phys & Image Proc Techn, Jinan 250014, Shandong, Peoples R China
[2] Shandong Normal Univ, Dept Phys & Elect, Jinan 250014, Shandong, Peoples R China
[3] Yancheng Biol Engn Higher Vocat Technol Sch, Yancheng 224051, Jiangsu, Peoples R China
[4] Shandong Univ Finance & Econ, Dept Comp Sci & Technol, Jinan 250014, Shandong, Peoples R China
[5] Stanford Univ, Dept Radiat Oncol, Med Phys Div, Palo Alto, CA 94305 USA
关键词
Video face tracking; Particle filter (PF); Features fusion; Updating model; Template drift; PARTICLE FILTERS; VISUAL TRACKING; COLOR;
D O I
10.1007/s11042-019-7414-x
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of monitoring equipment and artificial intelligence technology, video face tracking under the big data background has become an important research hot spot in the field of public security. In order to track robustly under the circumstances of illumination variation, background clutter, fast motion, partial occlusion and so on, this paper proposed an algorithm combining a multi-feature fusion in the frame of particle filter and an improved mechanism, which consists of three main steps. At first, the color and edge features of human face were extracted from the video sequence. Meanwhile, color histograms and edge orientation histograms (EOH) were used to describe the facial features and beneficial to improve the efficiency of calculation. Then we employed a self-adaptive features fusion strategy to calculate the particle weight, which can effectively enhance the reliability of face tracking. Moreover, in order to solve the computational efficiency problem caused by too many particles, we added the integral histogram method to simplify the calculation complexity. At last, the object model was updated between the current object model and the initial model for alleviating the model drifts. Experiments conducted on testing dataset show that this proposed approach can robustly track single face with the cases of complex backgrounds, such as similar skin color, illumination change and occlusion, and perform better than color-based and edge-based methods in terms of both quantitative metrics and visual quality.
引用
收藏
页码:21963 / 21980
页数:18
相关论文
共 50 条
  • [1] Multiple features fusion based video face tracking
    Tianping Li
    Pingping Zhou
    Hui Liu
    [J]. Multimedia Tools and Applications, 2019, 78 : 21963 - 21980
  • [2] The Video Face Recognition Method and System Based on The Fusion of Multiple Features
    Ye, Xin
    Zhu, Qiuyu
    [J]. 2017 10TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI), 2017,
  • [3] Multiple feature fusion-based video face tracking for IoT big data
    Liu, Zhifeng
    Ou, Jiayu
    Huo, Wenxiao
    Yan, Yejin
    Li, Tianping
    [J]. INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2022, 37 (12) : 10650 - 10669
  • [4] CONDENSATION METHOD FOR FACE TRACKING BASED ON FEATURES FUSION
    Zhang, Yong
    Li, Lan
    [J]. PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON ADVANCED COMPUTER THEORY AND ENGINEERING (ICACTE 2009), VOLS 1 AND 2, 2009, : 793 - 799
  • [5] Biometric and color features fusion for face detection and tracking in natural video sequences
    Zapata, Juan
    Ruiz, Ramon
    [J]. NATURE INSPIRED PROBLEM-SOLVING METHODS IN KNOWLEDGE ENGINEERING, PT 2, PROCEEDINGS, 2007, 4528 : 72 - +
  • [6] Video Concept Detection Based on Multiple Features and Classifiers Fusion
    Dong Yuan
    Zhang Jiwei
    Zhao Nan
    Chang Xiaofu
    Liu Wei
    [J]. CHINA COMMUNICATIONS, 2012, 9 (08) : 105 - 121
  • [7] Kernel-based Target Tracking with Multiple Features Fusion
    Qiu Xuena
    Liu Shirong
    Liu Fei
    [J]. PROCEEDINGS OF THE 48TH IEEE CONFERENCE ON DECISION AND CONTROL, 2009 HELD JOINTLY WITH THE 2009 28TH CHINESE CONTROL CONFERENCE (CDC/CCC 2009), 2009, : 3112 - 3117
  • [8] A Real Time Face Tracking System based on Multiple Information Fusion
    Zhichao Lian
    Shuai Shao
    Chanying Huang
    [J]. Multimedia Tools and Applications, 2020, 79 : 16751 - 16769
  • [9] A Real Time Face Tracking System based on Multiple Information Fusion
    Lian, Zhichao
    Shao, Shuai
    Huang, Chanying
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (23-24) : 16751 - 16769
  • [10] Face Tracking using Multiple Facial Features based on Particle Filter
    Tian Hui
    Chen Yi-qin
    Shen Ting-zhil
    [J]. 2010 2ND INTERNATIONAL ASIA CONFERENCE ON INFORMATICS IN CONTROL, AUTOMATION AND ROBOTICS (CAR 2010), VOL 3, 2010, : 72 - 75