Optimal marker set assessment for motion capture of 3D mimic facial (14) movements

被引:18
|
作者
Dagnes, Nicole [1 ,2 ]
Marcolin, Federica [2 ]
Vezzetti, Enrico [2 ]
Sarhan, Francois-Regis [3 ]
Dakpe, Stephanie [3 ,4 ,5 ]
Marin, Frederic [1 ]
Nonis, Francesca [2 ]
Ben Mansour, Khalil [1 ]
机构
[1] Univ Technol Compiegne, Sorbonne Univ, CNRS, UMR 7338, Compiegne, France
[2] Politecn Torino, Dept Management & Prod Engn, Turin, Italy
[3] CHU Amiens, Serv Chirurg Maxillofaciale, Amiens, France
[4] Inst Faire Faces, Amiens, France
[5] Univ Picardie Jules Verne, EA 7516 Chimere, Amiens, France
关键词
3D face; Face analysis; Motion capture; Marker optimization; Feature extraction;
D O I
10.1016/j.jbiomech.2019.06.012
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
Nowadays, facial mimicry studies have acquired a great importance in the clinical domain and 3D motion capture systems are becoming valid tools for analysing facial muscles movements, thanks to the remarkable developments achieved in the 1990s. However, the face analysis domain suffers from a lack of valid motion capture protocol, due to the complexity of the human face. Indeed, a framework for defining the optimal marker set layout does not exist yet and, up to date, researchers still use their traditional facial point sets with manually allocated markers. Therefore, the study proposes an automatic approach to compute a minimum optimized marker layout to be exploited in facial motion capture, able to simplify the marker allocation without decreasing the significance level. Specifically, the algorithm identifies the optimal facial marker layouts selecting the subsets of linear distances among markers that allow to automatically recognizing with the highest performances, through a k-nearest neighbours classification technique, the acted facial movements. The marker layouts are extracted from them. Various validation and testing phases have demonstrated the accuracy, robustness and usefulness of the custom approach. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页码:86 / 93
页数:8
相关论文
共 50 条
  • [1] Analysis of mimic facial movements based on motion capture
    Ben Mansour, K.
    Sarhan, F-R.
    Neiva, C.
    Godard, C.
    Devauchelle, B.
    Marin, F.
    Dakpe, S.
    COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING, 2014, 17 : 78 - 79
  • [2] Markerless 3D Facial Motion Capture System
    Hwang, Youngkyoo
    Kim, Jung-Bae
    Feng, Xuetao
    Bang, Won-Chul
    Rhee, Taehyun
    Kim, James D. K.
    Kim, ChangYeong
    ENGINEERING REALITY OF VIRTUAL REALITY 2012, 2012, 8289
  • [3] Facial Motion Capture with 3D Active Appearance Models
    Darujati, Cahyo
    Hariadi, Mochammad
    PROCEEDINGS OF 2013 3RD INTERNATIONAL CONFERENCE ON INSTRUMENTATION, COMMUNICATIONS, INFORMATION TECHNOLOGY, AND BIOMEDICAL ENGINEERING (ICICI-BME), 2013, : 59 - 64
  • [4] Automatic 3D Motion Capture of Swimming: Marker Resistance
    Kjendlie, Per-Ludvik
    Olstad, Bjorn Harald
    MEDICINE AND SCIENCE IN SPORTS AND EXERCISE, 2012, 44 : 476 - 476
  • [5] Redundancy Reduction in 3D Facial Motion Capture Data for Animation
    Wellein, Daniela I.
    Curio, Cristobal
    Buelthoff, Heinrich H.
    APGV 2007: SYMPOSIUM ON APPLIED PERCEPTION IN GRAPHICS AND VISUALIZATION, PROCEEDINGS, 2007, : 136 - 136
  • [6] Validation of pitchAI™ markerless motion capture using marker-based 3D motion capture
    Dobos, Tyler J.
    Bench, Ryan W. G.
    McKinnon, Colin D.
    Brady, Anthony
    Boddy, Kyle J.
    Holmes, Michael W. R.
    Sonne, Michael W. L.
    SPORTS BIOMECHANICS, 2022,
  • [7] A Distributed Approach to 3D Reconstruction in Marker Motion Capture Systems
    Cenedese, Angelo
    Varotto, Luca
    ICDSC 2019: 13TH INTERNATIONAL CONFERENCE ON DISTRIBUTED SMART CAMERAS, 2019,
  • [8] Human gait assessment using a 3D marker-less multimodal motion capture system
    Thiago Braga Rodrigues
    Debora Pereira Salgado
    Ciarán Ó Catháin
    Noel O’Connor
    Niall Murray
    Multimedia Tools and Applications, 2020, 79 : 2629 - 2651
  • [9] Human gait assessment using a 3D marker-less multimodal motion capture system
    Rodrigues, Thiago Braga
    Salgado, Debora Pereira
    Cathain, Ciaran O.
    O'Connor, Noel
    Murray, Niall
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (3-4) : 2629 - 2651
  • [10] Motion capture for 3D databases -: Overview of methods for motion capture in 3D databases
    Lupinek, Dalibor
    Drahansky, Martin
    SIGMAP 2008: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND MULTIMEDIA APPLICATIONS, 2008, : 99 - 104