MOTION EDITING TOOL FOR REPRODUCING GRAMMATICAL ELEMENTS OF JAPANESE SIGN LANGUAGE AVATAR ANIMATION

被引:1
|
作者
Uchida, Tsubasa [1 ]
Nakatani, Naoki [1 ]
Miyazaki, Taro [1 ]
Kaneko, Hiroyuki [1 ]
Sano, Masanori [1 ]
机构
[1] NHK Sci & Technol Res Labs, Tokyo, Japan
关键词
sign language; avatar animation; motion capture; motion editing;
D O I
10.1109/ICASSPW59220.2023.10193198
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
For deaf and hard of hearing people whose native language is sign language, it is necessary to provide information not only with subtitles but also with sign language. One means of providing information in sign language is to use animated avatars. Therefore, we have developed a system that generates a Japanese Sign Language (JSL) avatar animation from Japanese sentences utilizing Japanese-to-JSL translation and a motion-data-driven animation generation method. In this paper, we propose a motion editing tool that can adjust grammatical elements of JSL by editing each motion data forming a JSL sentence. An evaluation experiment shows that editing the motion speed and blend span of multiple words corresponding to the delimitation of phrases and clauses can reduce the error rate of understanding JSL avatar animations.
引用
收藏
页数:5
相关论文
共 20 条
  • [1] Body motion editor for sign language avatar
    Oh, Young-Joon
    Park, Kwang-Hyun
    Bien, Zeungnam
    2007 INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS, VOLS 1-6, 2007, : 568 - 573
  • [2] Turkish Sign Language Animation with Motion Capture
    Soylev, Arda
    Mendi, Engin
    2014 22ND SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2014, : 834 - 837
  • [3] Using a Signing Avatar as a Sign Language Research Tool
    Nelson, Delroy
    MULTIMODAL SIGNAL: COGNITIVE AND ALGORITHMIC ISSUES, 2009, 5398 : 83 - 93
  • [4] Grammatical differences between Japanese Sign Language, Pidgin Sign Japanese, and Manually Coded Japanese: Effects on comprehension
    Chonan, H
    JAPANESE JOURNAL OF EDUCATIONAL PSYCHOLOGY, 2001, 49 (04): : 417 - 426
  • [5] SIGN LANGUAGE AVATAR ANIMATION SEARCH: AN ANI2ANI SEARCH APPLICATION
    Huerta-Enochian, Mathew
    Ko, Changyong
    2023 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING WORKSHOPS, ICASSPW, 2023,
  • [6] ASL-Pro: American Sign Language Animation with Prosodic Elements
    Adamo-Villani, Nicoletta
    Wilbur, Ronnie B.
    UNIVERSAL ACCESS IN HUMAN-COMPUTER INTERACTION: ACCESS TO INTERACTION, PT II, 2015, 9176 : 307 - 318
  • [7] Sign language communication between Japanese-Korean and Japanese-Portuguese using CG animation
    Aoki, Y
    Mitsumori, R
    Li, JC
    Burger, A
    PROCEEDINGS OF THE 1998 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-6, 1998, : 3765 - 3768
  • [8] Real-time 3D sign language avatar animation from DTV closed captions
    Oh, Juhyun
    Kim, Byungsun
    Yang, Kisun
    Park, Sungchoon
    ABU Technical Review, 2015, (263): : 10 - 14
  • [9] Real-time Japanese sign language recognition based on three phonological elements of sign
    Sako, Shinji
    Hatano, Mika
    Kitamura, Tadashi
    Communications in Computer and Information Science, 2016, 618 : 130 - 136
  • [10] Real-Time Japanese Sign Language Recognition Based on Three Phonological Elements of Sign
    Sako, Shinji
    Hatano, Mika
    Kitamura, Tadashi
    HCI INTERNATIONAL 2016 - POSTERS' EXTENDED ABSTRACTS, PT II, 2016, 618 : 130 - 136