Cognitive Computing on Chinese Sign Language perception and comprehension

被引:0
|
作者
Yao, Dengfeng [1 ,2 ,3 ]
Jiang, Minghu [1 ,2 ]
Abulizi, Abudoukelimu [1 ,2 ]
Li, Hanjing [3 ]
机构
[1] Tsinghua Univ, Sch Humanities, Lab Computat Linguist, Beijing, Peoples R China
[2] Tsinghua Univ, Ctr Psychol & Cognit Sci, Beijing, Peoples R China
[3] Beijing Union Univ, Beijing Key Lab Informat Serv Engn, Beijing, Peoples R China
关键词
Cognitive Computing; Chinese Sign Language; perception; comprehension; DEAF; ATTENTION;
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
After a systematic review on psychological and neurophysiological studies, we propose a computational cognitive model for Chinese Sign Language (CSL) perception and comprehension with detailed algorithmic descriptions based on cognitive functionalities in human language processing. A semantic neural network based on this model is introduced as the knowledge representation method in CSL comprehension. In line with the actual attention of the deaf, a revised game theory is presented by assigning attention. This paper illustrates the applications of the proposed model in classifier predicative comprehension of CSL. After the spreading activation process, each handshape node is assigned with appropriate values that depend on the relationships nodes. Our experimental results demonstrate that the proposed model can effectively improve the performance of handshape associative memory.
引用
收藏
页码:90 / 97
页数:8
相关论文
共 50 条
  • [1] Taiwanese Sign Language and Chinese reading comprehension: Exploring relationships
    Liu, Hsiu Tan
    [J]. DEAFNESS & EDUCATION INTERNATIONAL, 2022, 24 (03) : 203 - 223
  • [2] Sign language comprehension:: The case of Spanish sign language
    Rodriguez-Ortiz, I. R.
    [J]. JOURNAL OF DEAF STUDIES AND DEAF EDUCATION, 2008, 13 (03): : 378 - 390
  • [3] Spanish sign language comprehension
    Rodriguez, Isabel R.
    [J]. INFANCIA Y APRENDIZAJE, 2007, 30 (01): : 87 - 107
  • [5] Chinese Deaf viewers' comprehension of sign language interpreting on television An experimental study
    Xiao, Xiaoyan
    Chen, Xiaoyan
    Palmer, Jeffrey Levi
    [J]. INTERPRETING, 2015, 17 (01) : 91 - 117
  • [6] American Sign Language Comprehension Test: A Tool for Sign Language Researchers
    Hauser, Peter C.
    Paludneviciene, Raylene
    Riddle, Wanda
    Kurz, Kim B.
    Emmorey, Karen
    Contreras, Jessica
    [J]. JOURNAL OF DEAF STUDIES AND DEAF EDUCATION, 2016, 21 (01): : 64 - 69
  • [7] Auditory perception and comprehension of language
    Marcel, E
    [J]. EVOLUTION PSYCHIATRIQUE, 1998, 63 (03): : 535 - 535
  • [8] The direct and indirect effects of language and cognitive skills on Chinese reading comprehension
    Zhao, Aiping
    Guo, Ying
    Dinnesen, Megan Schneider
    [J]. READING AND WRITING, 2022, 35 (03) : 539 - 564
  • [9] The direct and indirect effects of language and cognitive skills on Chinese reading comprehension
    Aiping Zhao
    Ying Guo
    Megan Schneider Dinnesen
    [J]. Reading and Writing, 2022, 35 : 539 - 564
  • [10] PERCEPTION OF SIGN LANGUAGE OF DEAF
    BREGER, I
    [J]. PERCEPTUAL AND MOTOR SKILLS, 1970, 31 (02) : 426 - &