The degree of congruence between test standards and test documentation within journal publications

The present study examined the extent to which testing practices comply with professional guidelines regarding examination of relevant reliability and validity evidence. The focus of testing use was limited to published research investigations appearing in 1992 American Psychological Association journals. Data regarding the use of paper and pencil tests, type of instrument, and reliability and validity information were abstracted from each article. Reliability and validity evidence supporting the use of a particular test for a specific contextual application was often lacking. Documentation of both of these key psychometric properties was reported for 20% of the 2,167 instruments used. About half (49%) of instrumentation was supported with evidence of one type or the other. When reported, test use was generally supported by internal consistency reliability and construct validity evidence.