Semi-automatic sign segmentation from sign language video corpus

被引:0
|
作者
Gonzalez, Matilde [1 ]
Collet, Christophe [2 ]
机构
[1] Univ Toulouse 3, F-31062 Toulouse 9, France
[2] Univ Toulouse 3, IRIT, F-31062 Toulouse 9, France
关键词
sign language; annotation; corpora; TRACKING; RECOGNITION; HAND; GESTURES; COLOR; FACE;
D O I
10.3166/TS.29.333-358
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many researches focus on the study of automatic sign language recognition. Many of them need a large amount of data to train the recognition systems. Our work addresses the annotation of sign language video corpus in order to collect training data. We propose a robust tracking algorithm for hands and head, a method to segment hands during occlusions and an approach to segment gestures using motion and hand shape features. In order to show the advantages and limitations of the proposed approaches, we have evaluated each one using international corpus. The full sign segmentation approach shows promising results.
引用
收藏
页码:333 / 358
页数:26
相关论文
共 50 条
  • [1] Semi-automatic Annotation Tool for Sign Languages
    Aitpayev, Kairat
    Islam, Shynggys
    Imashev, Alfarabi
    [J]. 2016 IEEE 10TH INTERNATIONAL CONFERENCE ON APPLICATION OF INFORMATION AND COMMUNICATION TECHNOLOGIES (AICT), 2016, : 731 - 734
  • [2] Design and Recording of Czech Sign Language Corpus for Automatic Sign Language Recognition
    Campr, Pavel
    Hruz, Marek
    Zelezny, Milos
    [J]. INTERSPEECH 2007: 8TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION, VOLS 1-4, 2007, : 2213 - 2216
  • [3] Semi-Automatic Sign Language Corpora Annotation using Lexical Representations of Signs
    Gonzalez, Matilde
    Filhol, Michael
    Collet, Christophe
    [J]. LREC 2012 - EIGHTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2012, : 2430 - 2434
  • [4] Semi-automatic video segmentation for object tracking
    Lim, J
    Ra, JB
    [J]. 2001 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL II, PROCEEDINGS, 2001, : 81 - 84
  • [5] Mexican Sign Language Corpus: Towards an Automatic Translator
    Trujillo-Romero, Felipe
    Garcia-Bautista, Gibran
    [J]. ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2023, 22 (08)
  • [6] Semi-Automatic Construction of a Readability Corpus for the Vietnamese Language
    Luong, An-Vinh
    Dinh, Dien
    [J]. VIETNAM JOURNAL OF COMPUTER SCIENCE, 2022, 09 (04) : 395 - 415
  • [7] A Semi-Automatic Traffic Sign Detection, Classification and Positioning System
    Creusen, I. M.
    Hazelhoff, L.
    De With, P. H. N.
    [J]. VISUAL INFORMATION PROCESSING AND COMMUNICATION III, 2012, 8305
  • [8] Semi-automatic video object segmentation in the presence of occlusion
    Toklu, C
    Tekalp, AM
    Erdem, AT
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2000, 10 (04) : 624 - 629
  • [9] Efficient generation of large amounts of training data for sign language recognition: A semi-automatic tool
    Yang, Ruiduo
    Sarkar, Sudeep
    Loeding, Barbara
    Karshmer, Arthur
    [J]. COMPUTERS HELPING PEOPLE WITH SPECIAL NEEDS, PROCEEDINGS, 2006, 4061 : 635 - 642
  • [10] Large Lexicon Project: American Sign Language Video Corpus and Sign Language Indexing/Retrieval Algorithms
    Athitsos, Vassilis
    Neidle, Carol
    Sclaroff, Stan
    Nash, Joan
    Stefan, Alexandra
    Thangali, Ashwin
    Wang, Haijing
    Yuan, Quan
    [J]. LREC 2010 - SEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2010, : A11 - A14