Multi-task feature learning-based improved supervised descent method for facial landmark detection

被引:8
|
作者
Bian, Peng [1 ]
Xie, Zhengnan [2 ,3 ]
Jin, Yi [2 ,3 ]
机构
[1] North China Univ Technol, Coll Mech & Mat Engn, Beijing 100144, Peoples R China
[2] Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
[3] Beijing Key Lab Traff Data Anal & Min, Beijing 100044, Peoples R China
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Facial landmark detection; Self-adapted model; Feature selection; Supervised descent method; Multi-task feature learning; MODELS;
D O I
10.1007/s11760-017-1125-4
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Facial landmark detection has played an important role in many face understanding tasks, such as face verification, facial expression recognition, age estimation et al. Model initialization and feature extraction are crucial in supervised landmark detection. Mismatching caused by detector error and discrepant initialization is very common in these existing methods. To solve this problem, we have proposed a new method called multi-task feature learning-based improved supervised descent method (MtFL-iSDM) for the robust facial landmark localization. In this new method, firstly, a fast detection will be processed to locate the eyes and mouth, and the initialization model will adapt to the real location according to fast facial points detection. Secondly, multi-task feature learning is adopted on our improved supervised descent method model to achieve a better performance. Experiments on four benchmark databases show that our method achieves state-of-the-art performance.
引用
收藏
页码:17 / 24
页数:8
相关论文
共 50 条
  • [1] Multi-task feature learning-based improved supervised descent method for facial landmark detection
    Peng Bian
    Zhengnan Xie
    Yi Jin
    [J]. Signal, Image and Video Processing, 2018, 12 : 17 - 24
  • [2] Facial Landmark Detection by Deep Multi-task Learning
    Zhang, Zhanpeng
    Luo, Ping
    Loy, Chen Change
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2014, PT VI, 2014, 8694 : 94 - 108
  • [3] Thermal Facial Landmark Detection by Deep Multi-Task Learning
    Chu, Wei-Ta
    Liu, Yu-Hui
    [J]. 2019 IEEE 21ST INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP 2019), 2019,
  • [4] Facial Landmark Detection via Self-adaption Model and Multi-task Feature Learning
    Xie, Zhengnan
    Jin, Yi
    Bian, Peng
    Zhou, Wei
    [J]. PROCEEDINGS OF 2016 IEEE 13TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP 2016), 2016, : 113 - 117
  • [5] Efficient Multi-task based Facial Landmark and Gesture Detection in Monocular Images
    Goenetxea, Jon
    Unzueta, Luis
    Elordi, Unai
    Otaegui, Oihana
    Dornaika, Fadi
    [J]. VISAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 5: VISAPP, 2021, : 680 - 687
  • [6] 3D facial landmark detection based on differential cylindrical projection and multi-task learning
    Terada, Takuma
    Kimura, Ryusuke
    Chen, Yen-Wei
    [J]. COMMUNICATIONS IN INFORMATION AND SYSTEMS, 2020, 20 (04) : 443 - 459
  • [7] Multi-task gradient descent for multi-task learning
    Bai, Lu
    Ong, Yew-Soon
    He, Tiantian
    Gupta, Abhishek
    [J]. MEMETIC COMPUTING, 2020, 12 (04) : 355 - 369
  • [8] Heterogeneous Multi-task Learning on Non-overlapping Datasets for Facial Landmark Detection
    Semitsu, Takayuki
    Zhao, Xiongxin
    Matsumoto, Wataru
    [J]. NEURAL INFORMATION PROCESSING, ICONIP 2016, PT III, 2016, 9949 : 616 - 625
  • [9] Multi-task gradient descent for multi-task learning
    Lu Bai
    Yew-Soon Ong
    Tiantian He
    Abhishek Gupta
    [J]. Memetic Computing, 2020, 12 : 355 - 369
  • [10] A MULTI-TASK LEARNING METHOD FOR WEAKLY SUPERVISED SOUND EVENT DETECTION
    Liu, Sichen
    Yang, Feiran
    Kang, Fang
    Yang, Jun
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 8802 - 8806