Multi-task Facial Landmark Detection Network for Early ASD Screening

被引:0
|
作者
Lin, Ruihan [1 ]
Zhang, Hanlin [1 ]
Wang, Xinming [1 ]
Ren, Weihong [1 ]
Wu, Wenhao [1 ]
Liu, Zuode [1 ]
Xu, Xiu [2 ]
Xu, Qiong [2 ]
Liu, Honghai [1 ]
机构
[1] Harbin Inst Technol, Sch Mech Engn & Automat, Shenzhen, Peoples R China
[2] Fudan Univ, Childrens Hosp, Dept Child Hlth Care, Shanghai, Peoples R China
关键词
Autism; Joint attention; Multi-task facial landmark detection; AUTISM; CHILDREN;
D O I
10.1007/978-3-031-13844-7_37
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Joint attention is an important skill that involves coordinating the attention of at least two individuals towards an object or event in early child development, which is usually absent in children with autism. Children's joint attention is an essential part of the diagnosis of autistic children. To improve the effectiveness of autism screening, in this paper, we propose a multi-task facial landmark detection network to enhance the stability of gaze estimation and the accuracy of the joint attention screening result. In order to verify the proposed method, we recruit 39 toddlers aged from 16 to 32 months in this study and build a children-based facial landmarks dataset from 19 subjects. Experiments show that the accuracy of the joint attention screening result is 92.5%, which demonstrates the effectiveness of our method.
引用
收藏
页码:381 / 391
页数:11
相关论文
共 50 条
  • [1] Facial Landmark Detection by Deep Multi-task Learning
    Zhang, Zhanpeng
    Luo, Ping
    Loy, Chen Change
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2014, PT VI, 2014, 8694 : 94 - 108
  • [2] Thermal Facial Landmark Detection by Deep Multi-Task Learning
    Chu, Wei-Ta
    Liu, Yu-Hui
    [J]. 2019 IEEE 21ST INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP 2019), 2019,
  • [3] Efficient Multi-task based Facial Landmark and Gesture Detection in Monocular Images
    Goenetxea, Jon
    Unzueta, Luis
    Elordi, Unai
    Otaegui, Oihana
    Dornaika, Fadi
    [J]. VISAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 5: VISAPP, 2021, : 680 - 687
  • [4] MULTI-TASK LEARNING NETWORK FOR LANDMARK DETECTION IN ANATOMICAL TREE STRUCTURES
    Tan, Zimeng
    Feng, Jianjiang
    Zhou, Jie
    [J]. 2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, : 1975 - 1979
  • [5] Heterogeneous Multi-task Learning on Non-overlapping Datasets for Facial Landmark Detection
    Semitsu, Takayuki
    Zhao, Xiongxin
    Matsumoto, Wataru
    [J]. NEURAL INFORMATION PROCESSING, ICONIP 2016, PT III, 2016, 9949 : 616 - 625
  • [6] Facial Landmark Detection via Self-adaption Model and Multi-task Feature Learning
    Xie, Zhengnan
    Jin, Yi
    Bian, Peng
    Zhou, Wei
    [J]. PROCEEDINGS OF 2016 IEEE 13TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP 2016), 2016, : 113 - 117
  • [7] Residual multi-task learning for facial landmark localization and expression recognition
    Chen, Boyu
    Guan, Wenlong
    Li, Peixia
    Ikeda, Naoki
    Hirasawa, Kosuke
    Lu, Huchuan
    [J]. PATTERN RECOGNITION, 2021, 115
  • [8] Simultaneous Estimation of Facial Landmark and Attributes with Separation Multi-task Networks
    Matsui, Ryo
    Yamashita, Takayoshi
    Fujiyoshi, Hironobu
    [J]. PROCEEDINGS OF THE 14TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2019, : 265 - 272
  • [9] 3D facial landmark detection based on differential cylindrical projection and multi-task learning
    Terada, Takuma
    Kimura, Ryusuke
    Chen, Yen-Wei
    [J]. COMMUNICATIONS IN INFORMATION AND SYSTEMS, 2020, 20 (04) : 443 - 459
  • [10] Multi-task feature learning-based improved supervised descent method for facial landmark detection
    Peng Bian
    Zhengnan Xie
    Yi Jin
    [J]. Signal, Image and Video Processing, 2018, 12 : 17 - 24