Collision Handling in 3D Articulatory Animation for Chinese Speech Articulation

被引:3
|
作者
Li, Rui [1 ]
Yu, Jun [2 ]
Wang, Zengfu [1 ]
机构
[1] Chinese Acad Sci, Inst Intelligent Machines, Hefei 230031, Peoples R China
[2] Univ Sci & Technol China, Hefei 230027, Peoples R China
来源
IFAC PAPERSONLINE | 2015年 / 48卷 / 28期
关键词
Multimedia; physiological models; computer-aided simulation; biological systems; detection algorithms; educational aids;
D O I
10.1016/j.ifacol.2015.12.269
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The aim of this paper is to efficiently handle collisions that happened in the oral cavity. We proposed a collision handling method which includes two stages: collision detection stage for detecting collisions happened among the tongue vs. teeth and the tongue vs. palate; and collision response stage which is used to avoid a physically impossible situation. Here, the physically impossible situation indicates that the. virtual tongue would penetrate the rest articulators in the oral cavity during its movements. The movements of the virtual tongue are driven by the data recorded by three electromagnetic articulography (EMA) sensors attached to a female Chinese speaker's tongue when the desired Chinese speech articulations are being articulated. Here, two Chinese speech articulations are used in our experiment to test our method: /ba/ and /t'a/. (C) 2015, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.
引用
收藏
页码:1047 / 1052
页数:6
相关论文
共 50 条
  • [21] Imitator: Personalized Speech-driven 3D Facial Animation
    Thambiraja, Balamurugan
    Habibie, Ikhsanul
    Aliakbarian, Sadegh
    Cosker, Darren
    Theobalt, Christian
    Thies, Justus
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 20564 - 20574
  • [22] Automatic Speech-Lip Synchronization System for 3D Animation
    Monroy, Juan
    Bellas, Francisco
    Duro, Richard J.
    Lopez, Ruben
    Puentes, Antonio
    Isaac, Jacques
    KNOWLEDGE-BASED AND INTELLIGENT INFORMATION AND ENGINEERING SYSTEMS, PT I, PROCEEDINGS, 2009, 5711 : 122 - +
  • [23] Speech-Driven 3D Facial Animation with Mesh Convolution
    Ji, Xuejie
    Su, Zewei
    Dong, Lanfang
    Li, Guoming
    2022 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, COMPUTER VISION AND MACHINE LEARNING (ICICML), 2022, : 14 - 18
  • [24] Speech4Mesh: Speech-Assisted Monocular 3D Facial Reconstruction for Speech-Driven 3D Facial Animation
    He, Shan
    He, Haonan
    Yang, Shuo
    Wu, Xiaoyan
    Xia, Pengcheng
    Yin, Bing
    Liu, Cong
    Dai, Lirong
    Xu, Chang
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 14146 - 14156
  • [25] CLTalk: Speech-Driven 3D Facial Animation with Contrastive Learning
    Zhang, Xitie
    Wu, Suping
    PROCEEDINGS OF THE 4TH ANNUAL ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2024, 2024, : 1175 - 1179
  • [26] EmoTalk: Speech-Driven Emotional Disentanglement for 3D Face Animation
    Peng, Ziqiao
    Wu, Haoyu
    Song, Zhenbo
    Xu, Hao
    Zhu, Xiangyu
    He, Jun
    Liu, Hongyan
    Fan, Zhaoxin
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 20630 - 20640
  • [27] Facial 3D Shape Estimation from Images for Visual Speech Animation
    Musti, Utpala
    Zhou, Ziheng
    Pietikainen, Matti
    2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, : 40 - 45
  • [28] End-to-end Learning for 3D Facial Animation from Speech
    Pham, Hai X.
    Wang, Yuting
    Pavlovic, Vladimir
    ICMI'18: PROCEEDINGS OF THE 20TH ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2018, : 361 - 365
  • [29] Real-time speech-driven 3D face animation
    Hong, PY
    Wen, Z
    Huang, TS
    Shum, HY
    FIRST INTERNATIONAL SYMPOSIUM ON 3D DATA PROCESSING VISUALIZATION AND TRANSMISSION, 2002, : 713 - 716
  • [30] 3D animation streaming
    Hash, Martin
    Hiromoto, Robert
    Harrison, Scott
    WEBIST 2006: Proceedings of the Second International Conference on Web Information Systems and Technologies: INTERNET TECHNOLOGY / WEB INTERFACE AND APPLICATIONS, 2006, : 457 - 460