Reliability of composite-task measurements of holistic face processing

There is growing interest in the study of individual differences in face recognition, including one of its hallmarks, holistic processing, which can be defined as a failure of selective attention to parts. These efforts demand that researchers be aware of, and try to maximize, the reliability of their measurements. Here we report on the reliability of measurements using the composite task (complete design), a measure of holistic processing that has been shown to have relatively good validity. Several studies have used the composite task to investigate individual differences, yet only one study has discussed its reliability. We investigate the reliability of composite-task measurements in eight data sets from five different samples of subjects. In general, we found reliability to be fairly low, but there was substantial variability across experiments. Researchers should keep in mind that reliability is a property of measurements, not of a task, and think about the ways in which measurements in a particular task may be improved before embarking on individual differences research.