Production and Comprehension of Prosodic Markers in Sign Language Imperatives

被引:9
|
作者
Brentari, Diane [1 ]
Falk, Joshua [1 ]
Giannakidou, Anastasia [1 ]
Herrmann, Annika [2 ]
Volk, Elisabeth [3 ,4 ]
Steinbach, Markus [3 ,4 ]
机构
[1] Univ Chicago, Dept Linguist, Ctr Study Gesture Sign & Language, Chicago, IL 60637 USA
[2] Univ Hamburg, Inst German Sign Language, Dept Language, Literature,Media 1, Hamburg, Germany
[3] Univ Gottingen, Dept German Philol, Sign Language Lab, Gottingen, Germany
[4] Univ Gottingen, Dept German Philol, RTG Understanding Social Relationships 2070, Gottingen, Germany
来源
FRONTIERS IN PSYCHOLOGY | 2018年 / 9卷
基金
美国国家科学基金会;
关键词
imperatives; speech acts; sign languages; gesture; prosody; semantics; non-manual markers; FACIAL EXPRESSIONS; VISUAL INTONATION; ASL; FACE; ACQUISITION;
D O I
10.3389/fpsyg.2018.00770
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
In signed and spoken language sentences, imperative mood and the corresponding speech acts such as for instance, command, permission or advice, can be distinguished by morphosyntactic structures, but also solely by prosodic cues, which are the focus of this paper. These cues can express paralinguistic mental states or grammatical meaning, and we show that in American Sign Language (ASL), they also exhibit the function, scope, and alignment of prosodic, linguistic elements of sign languages. The production and comprehension of prosodic facial expressions and temporal patterns therefore can shed light on how cues are grammaticalized in sign languages. They can also be informative about the formal semantic and pragmatic properties of imperative types not only in ASL, but also more broadly. This paper includes three studies: one of production (Study 1) and two of comprehension (Studies 2 and 3). In Study 1, six prosodic cues are analyzed in production: temporal cues of sign and hold duration, and non-manual cues including tilts of the head, head nods, widening of the eyes, and presence of mouthings. Results of Study 1 show that neutral sentences and commands are well distinguished from each other and from other imperative speech acts via these prosodic cues alone; there is more limited differentiation among explanation, permission, and advice. The comprehension of these five speech acts is investigated in Deaf ASL signers in Study 2, and in three additional groups in Study 3: Deaf signers of German Sign Language (DGS), hearing non-signers from the United States, and hearing nonsigners from Germany. Results of Studies 2 and 3 show that the ASL group performs significantly better than the other 3 groups and that all groups perform above chance for all meaning types in comprehension. Language-specific knowledge, therefore, has a significant effect on identifying imperatives based on targeted cues. Command has the most cues associated with it and is the most accurately identified imperative type across groups-indicating, we suggest, its special status as the strongest imperative in terms of addressing the speaker's goals. Our findings support the view that the cues are accessible in their content across groups, but that their language-particular combinatorial possibilities and distribution within sentences provide an advantage to ASL signers in comprehension and attest to their prosodic status.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] The relationship between sign production and sign comprehension: What handedness reveals
    Watkins, Freya
    Thompson, Robin L.
    [J]. COGNITION, 2017, 164 : 144 - 149
  • [32] Is it all relative? Effects of prosodic boundaries on the comprehension and production of attachment ambiguities
    Snedeker, Jesse
    Casserly, Elizabeth
    [J]. LANGUAGE AND COGNITIVE PROCESSES, 2010, 25 (7-9): : 1234 - 1264
  • [33] Production and Comprehension of Prosodic Boundary Marking in Persons With Unilateral Brain Lesions
    de Beer, Carola
    Hofmann, Andrea
    Regenbrecht, Frank
    Huttenlauch, Clara
    Wartenburger, Isabell
    Obrig, Hellmuth
    Hanne, Sandra
    [J]. JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2022, 65 (12): : 4774 - 4796
  • [34] Sign Language Production: A Review
    Rastgoo, Razieh
    Kiani, Kourosh
    Escalera, Sergio
    Sabokrou, Mohammad
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 3446 - 3456
  • [35] Discourse markers in French Belgian Sign Language (LSFB) and Catalan Sign Language (LSC)
    Gabarro-Lopez, Silvia
    [J]. SIGN LANGUAGE & LINGUISTICS, 2018, 21 (01) : 153 - 162
  • [36] Can experience with co-speech gesture influence the prosody of a sign language? Sign language prosodic cues in bimodal bilinguals
    Brentari, Diane
    Nadolske, Marie A.
    Wolford, George
    [J]. BILINGUALISM-LANGUAGE AND COGNITION, 2012, 15 (02) : 402 - 412
  • [37] PROSODIC COMPREHENSION AND EXPRESSION IN SCHIZOPHRENIA
    MURPHY, D
    CUTTING, J
    [J]. JOURNAL OF NEUROLOGY NEUROSURGERY AND PSYCHIATRY, 1990, 53 (09): : 727 - 730
  • [38] LANGUAGE COMPREHENSION AND PRODUCTION IN DULL ADOLESCENTS
    CAVERS, HH
    [J]. BULLETIN OF THE BRITISH PSYCHOLOGICAL SOCIETY, 1973, 26 (92): : 260 - 260
  • [39] Asymmetries Between Language Production and Comprehension
    Putnam, Michael T.
    [J]. JOURNAL OF GERMANIC LINGUISTICS, 2017, 29 (02) : 200 - 204
  • [40] COMPREHENSION AND PRODUCTION IN INTERACTIVE LANGUAGE TEACHING
    RIVERS, WM
    [J]. MODERN LANGUAGE JOURNAL, 1986, 70 (01): : 1 - 7