Movement Trajectory Recognition of Sign Language Based on Optimized Dynamic Time Warping

被引:12
|
作者
Li, Wenguo [1 ,2 ]
Luo, Zhizeng [1 ]
Xi, Xugang [1 ]
机构
[1] Hangzhou Dianzi Univ, Inst Intelligent Control & Robot, Hangzhou 310018, Peoples R China
[2] Xianheng Int Hangzhou Elect Mfg Co Ltd, Hangzhou 310022, Peoples R China
基金
中国国家自然科学基金;
关键词
sign language; coordinate transformation; generalized linear regression; dynamic time warping; trajectory recognition; MODEL;
D O I
10.3390/electronics9091400
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Movement trajectory recognition is the key link of sign language (SL) translation research, which directly affects the accuracy of SL translation results. A new method is proposed for the accurate recognition of movement trajectory. First, the gesture motion information collected should be converted into a fixed coordinate system by the coordinate transformation. The SL movement trajectory is reconstructed using the adaptive Simpson algorithm to maintain the originality and integrity of the trajectory. The algorithm is then extended to multidimensional time series by using Mahalanobis distance (MD). The activation function of generalized linear regression (GLR) is modified to optimize the dynamic time warping (DTW) algorithm, which ensures that the local shape characteristics are considered for the global amplitude characteristics and avoids the problem of abnormal matching in the process of trajectory recognition. Finally, the similarity measure method is used to calculate the distance between two warped trajectories, to judge whether they are classified to the same category. Experimental results show that this method is effective for the recognition of SL movement trajectory, and the accuracy of trajectory recognition is 86.25%. The difference ratio between the inter-class features and intra-class features of the movement trajectory is 20, and the generalization ability of the algorithm can be effectively improved.
引用
收藏
页码:1 / 16
页数:15
相关论文
共 50 条
  • [1] Vision Based Hand Gesture Recognition Using Dynamic Time Warping for Indian Sign Language
    Ahmed, Washef
    Chanda, Kunal
    Mitra, Soma
    [J]. PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE (ICIS), 2016, : 120 - 125
  • [2] PROCRUSTES-DTW: DYNAMIC TIME WARPING VARIANT FOR THE RECOGNITION OF SIGN LANGUAGE UTTERANCES
    Arvanitis, Nikolaos
    Sartinas, Evangelos
    Kosmopoulos, Dimitrios
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING WORKSHOPS, ICASSPW, 2023,
  • [3] Dynamic Time Warping Based Sign Retrieval
    Tamer, Nazif Can
    Ozdemir, Ogulcan
    Saraclar, Murat
    Akarun, Lale
    [J]. 2019 27TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2019,
  • [4] Implementation of Dynamic Time Warping for Gesture Recognition in Sign Language using High Performance Computing
    Salagar, Muaaz
    Kulkarni, Pranav
    Gondane, Saurabh
    [J]. 2013 INTERNATIONAL CONFERENCE ON HUMAN COMPUTER INTERACTIONS (ICHCI), 2013,
  • [5] Trajectory based Arabic Sign Language Recognition
    Sidig, Ala Addin I.
    Mahmoud, Sabri A.
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2018, 9 (04) : 283 - 291
  • [6] A Subunit-Based Dynamic Time Warping Approach for Hand Movement Recognition
    Wang, Yanrung
    Shimada, Atsushi
    Yamashita, Takayoshi
    Taniguchi, Rin-ichiro
    [J]. IMAGE ANALYSIS AND PROCESSING (ICIAP 2013), PT 1, 2013, 8156 : 672 - 681
  • [7] Structured dynamic time warping for continuous hand trajectory gesture recognition
    Tang, Jingren
    Cheng, Hong
    Zhao, Yang
    Guo, Hongliang
    [J]. PATTERN RECOGNITION, 2018, 80 : 21 - 31
  • [8] Dynamic Sign Language Recognition Based on Real-Time Videos
    Al-Mohimeed, Bushra A.
    Al-Harbi, Hessa O.
    Al-Dubayan, Ghadah S.
    Al-Shargabi, Amal A.
    [J]. INTERNATIONAL JOURNAL OF ONLINE AND BIOMEDICAL ENGINEERING, 2022, 18 (01) : 4 - 14
  • [9] Mexican Sign Language Recognition Using Kinect and Data Time Warping Algorithm
    Garcia-Bautista, Gibran
    Trujillo-Romero, Felipe
    Omar Caballero-Morales, Santiago
    [J]. 2017 INTERNATIONAL CONFERENCE ON ELECTRONICS, COMMUNICATIONS AND COMPUTERS (CONIELECOMP), 2017,
  • [10] Trajectory-based recognition of dynamic Persian sign language using hidden Markov model
    Azar, Saeideh Ghanbari
    Seyedarabi, Hadi
    [J]. COMPUTER SPEECH AND LANGUAGE, 2020, 61