Promises and pitfalls of machine scoring of the Index of Productive Syntax

被引:5
|
作者
Altenberg, Evelyn P. [1 ]
Roberts, Jenny A. [1 ]
机构
[1] Hofstra Univ, Dept Speech Language Hearing Sci, Davison 106, Hempstead, NY 11549 USA
关键词
Assessment; IPSyn; computer analysis; child language; morphosyntax; GRAMMATICAL DEVELOPMENT; LANGUAGE; CHILDREN;
D O I
10.3109/02699206.2016.1139184
中图分类号
R36 [病理学]; R76 [耳鼻咽喉科学];
学科分类号
100104 ; 100213 ;
摘要
The AC-IPSyn computerised system for scoring the Index of Productive Syntax (IPSyn) was evaluated. Twenty language samples, ten taken at 30 months and ten of the same children at 42 months, were each scored for the IPSyn by hand and by AC-IPSyn. Point differences and point-to-point reliability were examined at the levels of the total, subscale, and individual structure scores. Points missed and erroneously given at each level were also analysed. The difference in total scores between manual and AC-IPSyn scoring was relatively small; point-to-point agreement was lower than reported elsewhere. Age differences were also found. AC-IPSyn accuracy varied by subscale and structure, with results suggesting that AC-IPSyn be used at this point in conjunction with hand scoring of more errorprone and low frequency structures. The relatively small total point difference masked the lower reliability revealed by other measures, demonstrating the importance of detailed comparisons of manual and machine scoring.
引用
收藏
页码:433 / 448
页数:16
相关论文
共 50 条
  • [1] The Adaptation of Developmental Sentence Scoring and Index of Productive Syntax to Turkish
    Saban-Dulger, Nur Seda
    Turan, Figen
    Ozcebe, Esra
    [J]. JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2022, 65 (03): : 1001 - 1024
  • [2] INDEX OF PRODUCTIVE SYNTAX
    SCARBOROUGH, HS
    [J]. APPLIED PSYCHOLINGUISTICS, 1990, 11 (01) : 1 - 22
  • [3] Machine Ethics Research: Promises and Potential Pitfalls
    Otterbacher, Jahna
    Manolopoulos, Yannis
    [J]. IEEE INTELLIGENT SYSTEMS, 2023, 38 (04) : 62 - 68
  • [4] The Index of Productive Syntax: Psychometric Properties and Suggested Modifications
    Yang, Ji Seung
    MacWhinney, Brian
    Ratner, Nan Bernstein
    [J]. AMERICAN JOURNAL OF SPEECH-LANGUAGE PATHOLOGY, 2022, 31 (01) : 239 - 256
  • [5] Automatic generation of the index of productive syntax for child language transcripts
    Khairun-nisa Hassanali
    Yang Liu
    Aquiles Iglesias
    Thamar Solorio
    Christine Dollaghan
    [J]. Behavior Research Methods, 2014, 46 : 254 - 262
  • [6] Automatic generation of the index of productive syntax for child language transcripts
    Hassanali, Khairun-nisa
    Liu, Yang
    Iglesias, Aquiles
    Solorio, Thamar
    Dollaghan, Christine
    [J]. BEHAVIOR RESEARCH METHODS, 2014, 46 (01) : 254 - 262
  • [7] Applying Machine Learning to Facilitate Autism Diagnostics: Pitfalls and Promises
    Bone, Daniel
    Goodwin, Matthew S.
    Black, Matthew P.
    Lee, Chi-Chun
    Audhkhasi, Kartik
    Narayanan, Shrikanth
    [J]. JOURNAL OF AUTISM AND DEVELOPMENTAL DISORDERS, 2015, 45 (05) : 1121 - 1136
  • [8] The Promises and Pitfalls of Machine Learning for Detecting Viruses in Aquatic Metagenomes
    Ponsero, Alise J.
    Hurwitz, Bonnie L.
    [J]. FRONTIERS IN MICROBIOLOGY, 2019, 10
  • [9] Applying Machine Learning to Facilitate Autism Diagnostics: Pitfalls and Promises
    Daniel Bone
    Matthew S. Goodwin
    Matthew P. Black
    Chi-Chun Lee
    Kartik Audhkhasi
    Shrikanth Narayanan
    [J]. Journal of Autism and Developmental Disorders, 2015, 45 : 1121 - 1136
  • [10] PROMISES AND PITFALLS
    GREENBERG, S
    [J]. NATION, 1966, 202 (21) : 617 - 620