Effect of processing speed and memory performance on classification accuracy of the dot counting test in a mixed neuropsychiatric sample

被引:0
|
作者
Phillips, Matthew S. [1 ]
Wisinger, Amanda M. [1 ]
Cerny, Brian M. [1 ,2 ]
Khan, Humza [1 ,2 ]
Chang, Fini [1 ,3 ]
Tse, Ka Yin Phoebe [1 ,4 ]
Ovsiew, Gabriel P. [1 ]
Resch, Zachary J. [1 ]
Shapiro, Greg [1 ,4 ]
Soble, Jason R. [1 ,5 ]
Jennette, Kyle J. [1 ]
机构
[1] Univ Illinois, Coll Med, Dept Psychiat, 912 S Wood St, Chicago, IL 60612 USA
[2] IIT, Dept Psychol, Chicago, IL USA
[3] Univ Illinois, Dept Psychol, Chicago, IL USA
[4] Chicago Sch, Dept Clin Psychol, Chicago, IL USA
[5] Univ Illinois, Coll Med, Dept Neurol, Chicago, IL USA
关键词
Dot counting test; performance validity; psychometrics; Neuropsychology; cognitive impairment; MALINGERING DETECTION; VALIDITY; SPECIFICITY; VALIDATION; INDICATOR;
D O I
10.1080/13803395.2024.2363978
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
ObjectiveThis study examined the impact of impairment in two specific cognitive abilities, processing speed and memory, on Dot Counting Test (DCT) classification accuracy by evaluating performance validity classification accuracy across cognitively unimpaired, single-domain impairment, and multidomain impairment subgroups within a mixed clinical sample.MethodCross-sectional data were analyzed from 348 adult outpatients classified as valid (n = 284) or invalid (n = 64) based on four independent criterion performance validity tests (PVTs). Unimpaired (n = 164), single-domain processing speed impairment (n = 24), single-domain memory impairment (n = 53), and multidomain processing speed and memory impairment (n = 43) clinical subgroups were established among the valid group. Both the traditional DCT E-score and unrounded E-score were examined.ResultsOverall, the DCT demonstrated acceptable to excellent classification accuracy across the unimpaired (area under the curve [AUC] traditional E-score=.855; unrounded E-score=.855) and single-domain impairment groups (traditional E-score AUCs = .690-.754; unrounded E-score AUCs = .692-747). However, it did not reliably discriminate the multidomain processing speed and memory impairment group from the invalid performers (traditional and unrounded E-scores AUC = .557).ConclusionsFindings support the DCT as a non-memory-based freestanding PVT for use with single-domain cognitive impairment, with traditional E-score >= 17 (unrounded E-score >= 16.95) recommended for those with memory impairment and traditional E-score >= 19 (unrounded >= 18.08) with processing speed impairment. Moreover, results replicated previously established optimal cutoffs for unimpaired groups using both the traditional (>= 14) and unrounded (>= 13.84) E-scores. However, the DCT did not reliably discriminate between invalid performance and multidomain cognitive impairment, indicating caution is warranted when using the DCT with patients suspected of greater cognitive impairment.
引用
收藏
页码:522 / 534
页数:13
相关论文
共 26 条
  • [1] Not so fast! Limitations of processing speed and working memory indices as embedded performance validity tests in a mixed neuropsychiatric sample
    Ovsiew, Gabriel P.
    Resch, Zachary J.
    Nayar, Kritika
    Williams, Christopher P.
    Soble, Jason R.
    JOURNAL OF CLINICAL AND EXPERIMENTAL NEUROPSYCHOLOGY, 2020, 42 (05) : 473 - 484
  • [2] Performance on the Test of Memory Malingering in a mixed pediatric sample
    Donders, J
    CHILD NEUROPSYCHOLOGY, 2005, 11 (02) : 221 - 227
  • [3] The Dot Counting Test adds up: Validation and response pattern analysis in a mixed clinical veteran sample
    Soble, Jason R.
    Santos, Octavio A.
    Bain, Kathleen M.
    Kirton, Joshua W.
    Bailey, K. Chase
    Critchfield, Edan A.
    O'Rourke, Justin J. F.
    Highsmith, Jonathan M.
    Gonzalez, David Andres
    JOURNAL OF CLINICAL AND EXPERIMENTAL NEUROPSYCHOLOGY, 2018, 40 (04) : 317 - 325
  • [4] Evaluation of the classification accuracy of multiple performance validity tests in a mixed clinical sample
    Messerly, Johanna
    Soble, Jason R.
    Webber, Troy A.
    Alverson, W. Alex
    Fullen, Chrystal
    Kraemer, Lindsay D.
    Marceaux, Janice C.
    APPLIED NEUROPSYCHOLOGY-ADULT, 2021, 28 (06) : 727 - 736
  • [5] Classification Accuracy of WMS-IV Verbal Paired Associates Recognition as an Embedded Performance Validity Test in a Mixed Outpatient Sample
    Skinner, R. B.
    Berumen, M.
    Raines, J. M.
    Snodgrass, M.
    Matyi, J. M.
    Martin, P. K.
    CLINICAL NEUROPSYCHOLOGIST, 2024, 38 (04) : 878 - 878
  • [6] The classification accuracy of Warrington's recognition memory test (words) as a performance validity Test in a neurorehabilitation setting
    Parsons, Jenna
    Rodrigues, Nelson B.
    Erdodi, Laszlo A.
    APPLIED NEUROPSYCHOLOGY-ADULT, 2024,
  • [7] Working Memory, Processing Speed, and Memory Functioning Are Minimally Predictive of Victoria Symptom Validity Test Performance
    Resch, Zachary J.
    Soble, Jason R.
    Ovsiew, Gabriel P.
    Castillo, Liliam R.
    Saladino, Kevin F.
    DeDios-Stern, Samantha
    Schulze, Evan T.
    Song, Woojin
    Pliskin, Neil H.
    ASSESSMENT, 2021, 28 (06) : 1614 - 1623
  • [8] Incidental recall performance on a processing speed test is associated with verbal memory abilities in multiple sclerosis
    Mavis, C.
    Roberg, B.
    O'Bryan, S.
    Wilson, L.
    Williams, B.
    Ray, C.
    Lynch, S.
    Bruce, J.
    MULTIPLE SCLEROSIS JOURNAL, 2014, 20 : 136 - 136
  • [9] THE EFFECT OF VARIATIONS IN ANSWER SHEET FORMAT ON PERFORMANCE ON THE DAT CLERICAL SPEED AND ACCURACY TEST
    HODGKINSON, GP
    EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1987, 47 (02) : 473 - 475
  • [10] Cross-Validating Grooved Pegboard as Embedded Performance Validity Test in a Mixed Neuropsychiatric Sample with Varying Degrees of Cognitive Impairment
    Chang, F.
    Tse, P. K. Y.
    Khan, H.
    Ovsiew, G. P.
    Resch, Z. J.
    Soble, J. R.
    CLINICAL NEUROPSYCHOLOGIST, 2022, 36 (04) : 773 - 773