Pause detection in continuous sign language

被引:4
|
作者
Khan, Shujjat [1 ]
Bailey, Donald G. [1 ]
Sen Gupta, Gourab [1 ]
机构
[1] Massey Univ, Sch Engn & Adv Technol, Palmerston North, New Zealand
关键词
sign language; segmentation; word localisation; pause; recognition;
D O I
10.1504/IJCAT.2014.063910
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Sign language segmentation breaks a continuous sentence into its basic lexical units by detecting word boundaries. For robust recognition, the majority of direct segmentation approaches exploit these inter-sign pauses in a stream of hand gestures to demarcate word boundaries. Recent attempts to segment a continuous discourse exploit the constancy or directional variations of sign parameters (mainly spatial parameters). The delayed absolute difference (DAD) signature of hand positions provides means for analysing the segmentation features like pauses, repetitions and directional variations in a unique tool. In this paper, a DAD-based pause detection algorithm has been described. The performance of this deterministic algorithm is compared with three segmentation approaches. All the experiments and comparisons are done using the subjective annotation by 15 native New Zealand Sign Language (NZSL) signers. The proposed algorithm correctly and consistently detected the various lengths of pauses as compared to the existing segmentation approaches.
引用
收藏
页码:75 / 83
页数:9
相关论文
共 50 条
  • [1] Semantic Boundary Detection With Reinforcement Learning for Continuous Sign Language Recognition
    Wei, Chengcheng
    Zhao, Jian
    Zhou, Wengang
    Li, Houqiang
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (03) : 1138 - 1149
  • [2] Detecting pauses in continuous sign language
    Khan, Shujjat
    Bailey, Donald
    Sen Gupta, Gourab
    [J]. 2012 19TH INTERNATIONAL CONFERENCE MECHATRONICS AND MACHINE VISION IN PRACTICE (M2VIP), 2012, : 11 - 15
  • [3] A demonstration for the detection of sign language
    Purkayastha, Shauvik
    Roy, Mridul Jyoti
    Pradhan, Navam
    [J]. JOURNAL OF INFORMATION & OPTIMIZATION SCIENCES, 2019, 40 (08): : 1611 - 1621
  • [4] Subunit sign modeling framework for continuous sign language recognition
    Elakkiya, R.
    Selvamani, K.
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2019, 74 : 379 - 390
  • [5] Video Analysis for Continuous Sign Language Recognition
    Piater, Justus
    Hoyoux, Thomas
    Du, Wei
    [J]. LREC 2010 - SEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2010, : A192 - A195
  • [6] Continuous Sign Language Recognition with Correlation Network
    Hu, Lianyu
    Gao, Liqing
    Liu, Zekang
    Feng, Wei
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 2529 - 2539
  • [7] Adversarial autoencoder for continuous sign language recognition
    Kamal, Suhail Muhammad
    Chen, Yidong
    Li, Shaozi
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2024,
  • [8] Continuous Sign Language Recognition with Correlation Network
    Hu, Lianyu
    Gao, Liqing
    Liu, Zekang
    Feng, Wei
    [J]. arXiv, 2023,
  • [9] LSA-T: The First Continuous Argentinian Sign Language Dataset for Sign Language Translation
    Dal Bianco, Pedro
    Rios, Gaston
    Ronchetti, Franco
    Quiroga, Facundo
    Stanchi, Oscar
    Hasperue, Waldo
    Rosete, Alejandro
    [J]. ADVANCES IN ARTIFICIAL INTELLIGENCE-IBERAMIA 2022, 2022, 13788 : 293 - 304
  • [10] Large lexicon detection of sign language
    Cooper, Helen
    Bowden, Richard
    [J]. HUMAN-COMPUTER INTERACTION, PROCEEDINGS, 2007, 4796 : 88 - 97