Best Practice for Sign Language Data Collections Regarding the Needs of Data-Driven Recognition and Translation

被引:0
|
作者
Forster, Jens [1 ]
Stein, Daniel [1 ]
Ormel, Ellen [2 ]
Crasborn, Onno [2 ]
Ney, Hermann [1 ]
机构
[1] Rhein Westfal TH Aachen, Human Language Technol & Pattern Recognit, Aachen, Germany
[2] Radboud Univ Nijmegen, Dept Linguist, NL-6525 ED Nijmegen, Netherlands
关键词
D O I
暂无
中图分类号
H [语言、文字];
学科分类号
05 ;
摘要
We propose best practices for gloss annotation of sign languages taking into account the needs of data-driven approaches to recognition and translation of natural languages. Furthermore, we provide reference numbers for several technical aspects for the creation of new sign language data collections. Most available sign language data collections are of limited use to data-driven approaches, because they focus on rare sign language phenomena, or lack machine readable annotation schemes. Using a natural language processing point of view, we briefly discuss several sign language data collection, propose best practices for gloss annotation stemming from experience gained using two large scale sign language data collections, and derive reference numbers for several technical aspects from standard benchmark data collections for speech recognition and translation.
引用
收藏
页码:A92 / A97
页数:6
相关论文
共 50 条
  • [1] A Data-Driven Representation for Sign Language Production
    Walsh, Harry
    Ravanshad, Abolfazl
    Rahmani, Mariam
    Bowden, Richard
    2024 IEEE 18TH INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, FG 2024, 2024,
  • [2] Matching chemistry collections and user needs: A data-driven approach
    Alvaro, Elsa
    ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 2017, 253
  • [3] Data-driven development of Virtual Sign Language Communication Agents
    Brock, Heike
    Balayn, Agathe
    Nakadai, Kazuhiro
    2018 27TH IEEE INTERNATIONAL SYMPOSIUM ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (IEEE RO-MAN 2018), 2018, : 370 - 377
  • [4] A data-driven approach to the semantics of iconicity in American Sign Language and English
    Thompson, Bill
    Perlman, Marcus
    Lupyan, Gary
    Sevcikova Sehyr, Zed
    Emmorey, Karen
    LANGUAGE AND COGNITION, 2020, 12 (01) : 182 - 202
  • [5] The Best of Both Worlds: Combining Data-independent and Data-driven Approaches for Action Recognition
    Lan, Zhenzhong
    Yu, Shoou-I
    Yao, Dezhong
    Lin, Ming
    Raj, Bhiksha
    Hauptmann, Alexander
    PROCEEDINGS OF 29TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, (CVPRW 2016), 2016, : 1196 - 1205
  • [6] Data-Driven Sub-Units and Modeling Structure for Continuous Sign Language Recognition with Multiple-Cues
    Pitsikalis, Vassilis
    Theodorakis, Stavros
    Maragos, Petros
    LREC 2010 - SEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2010, : A196 - A203
  • [7] Sign language recognition and translation network based on multi-view data
    Ronghui Li
    Lu Meng
    Applied Intelligence, 2022, 52 : 14624 - 14638
  • [8] Sign language recognition and translation network based on multi-view data
    Li, Ronghui
    Meng, Lu
    APPLIED INTELLIGENCE, 2022, 52 (13) : 14624 - 14638
  • [9] Using Data-Driven Approach for Modeling Timing Parameters of American Sign Language
    Al-Khazraji, Sedeeq
    ICMI'18: PROCEEDINGS OF THE 20TH ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2018, : 497 - 500
  • [10] Improving Sign Language Translation with Monolingual Data by Sign Back-Translation
    Zhou, Hao
    Zhou, Wengang
    Qi, Weizhen
    Pu, Junfu
    Li, Houqiang
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 1316 - 1325