LSA-T: The First Continuous Argentinian Sign Language Dataset for Sign Language Translation

被引:3
|
作者
Dal Bianco, Pedro [1 ,3 ]
Rios, Gaston [1 ,3 ]
Ronchetti, Franco [1 ,2 ]
Quiroga, Facundo [1 ,3 ]
Stanchi, Oscar [1 ]
Hasperue, Waldo [1 ,2 ]
Rosete, Alejandro [4 ]
机构
[1] Univ Nacl La Plata, Inst Invest Informat LIDI, La Plata, Argentina
[2] CIC PBA, La Plata, Argentina
[3] UNLP, La Plata, Argentina
[4] Univ Tecnol La Habana Jose Antonio Echeverria, Havana, Cuba
关键词
Sign Language Translation; Computer vision; Big data; Sign language dataset; Deep learning;
D O I
10.1007/978-3-031-22419-5_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sign language translation (SLT) is an active field of study that encompasses human-computer interaction, computer vision, natural language processing and machine learning. Progress on this field could lead to higher levels of integration of deaf people. This paper presents, to the best of our knowledge, the first continuous Argentinian Sign Language (LSA) dataset. It contains 14,880 sentence level videos of LSA extracted from the CN Sordos YouTube channel with labels and keypoints annotations for each signer. We also present a method for inferring the active signer, a detailed analysis of the characteristics of the dataset, a visualization tool to explore the dataset and a neural SLT model to serve as baseline for future experiments.
引用
收藏
页码:293 / 304
页数:12
相关论文
共 50 条
  • [1] Sign language images dataset from Mexican sign language
    Espejel, Josue
    Jalili, Laura D.
    Cervantes, Jair
    Canales, Jared Cervantes
    [J]. DATA IN BRIEF, 2024, 55
  • [2] Sign Language Translation
    Harini, R.
    Janani, R.
    Keerthana, S.
    Madhubala, S.
    Venkatasubramanian, S.
    [J]. 2020 6TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING AND COMMUNICATION SYSTEMS (ICACCS), 2020, : 883 - 886
  • [3] Challenges with Sign Language Datasets for Sign Language Recognition and Translation
    De Sisto, Mirella
    Vandeghinste, Vincent
    Gomez, Santiago Egea
    De Coster, Mathieu
    Shterionov, Dimitar
    Saggion, Horacio
    [J]. LREC 2022: THIRTEEN INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2022, : 2478 - 2487
  • [4] A Cross-Dataset Study on the Brazilian Sign Language Translation
    de Avellar Sarmento, Amanda Hellen
    Ponti, Moacir Antonelli
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 2808 - 2812
  • [5] A unified approach for continuous sign language recognition and translation
    Sharma, Vaidehi
    Gupta, Abhay Kumar
    Sharma, Abhishek
    Saini, Sandeep
    [J]. INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS, 2024,
  • [6] A recognition method of sign language sentences for Japanese sign language translation
    Sagawa, H
    Takeuchi, M
    [J]. PROCEEDINGS OF THE FIFTH JOINT CONFERENCE ON INFORMATION SCIENCES, VOLS 1 AND 2, 2000, : A858 - A861
  • [7] Translation and Interpretation of Sign Language
    de Quadros, Ronice Mueller
    [J]. CADERNOS DE TRADUCAO, 2010, 26 (02): : 9 - 12
  • [8] Neural Sign Language Translation
    Camgoz, Necati Cihan
    Hadfield, Simon
    Koller, Oscar
    Ney, Hermann
    Bowden, Richard
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 7784 - 7793
  • [9] Assistive Glove for Pakistani Sign Language Translation Pakistani Sign Language Translator
    Kanwal, Kehkashan
    Abdullah, Saad
    Ahmed, Yusra Binte
    Saher, Yusra
    Jafri, Ali Raza
    [J]. 17TH IEEE INTERNATIONAL MULTI TOPIC CONFERENCE 2014, 2014, : 173 - 176
  • [10] Slovo: Russian Sign Language Dataset
    Kapitanov, Alexander
    Karina, Kvanchiani
    Nagaev, Alexander
    Elizaveta, Petrova
    [J]. COMPUTER VISION SYSTEMS, ICVS 2023, 2023, 14253 : 63 - 73