Language testers operate within two frames of reference: norm-referenced (NRT) and criterion-referenced testing (CRT). The former underpins the world of large-scale standardized testing that prioritizes variability and comparison. The latter supports substantive score meaning in formative and domain specific assessment. Some claim that the…

This article illustrates how test specifications based solely on academic content standards, without attention to other cognitive skills and item response demands, can fall short of their targeted constructs. First, the authors inductively describe the science achievement construct represented by a statewide sixth-grade science proficiency test.…

Developed for the Armed Services Vocational Aptitude Battery (ASVAB) Career Exploration Program, the Find Your Interests (FYI) inventory was designed to help students learn about their career-related interests. The FYI is a 90-item interest inventory based on Holland's (1973, 1985, 1997) widely accepted theory and taxonomy of career choice. The…

This study examined the content validity of a juvenile psychopathy measure, the Childhood Psychopathy Scale (CPS; D. R. Lynam, 1997), based on a downward translation of an adult instrument, the Hare Psychopathy Checklist-Revised (PCL-R; R. D. Hare, 1991). The CPS was compared with two other indices of juvenile psychopathy: (a) an index derived…

An empirically based 78 question self-rating scale based on DSM-IV-TR and ICD-10 criteria was developed to assist clinicians' diagnosis of adults with autism and Asperger's Disorder-the Ritvo Autism and Asperger's Diagnostic Scale (RAADS). It was standardized on 17 autistic and 20 Asperger's Disorder and 57 comparison subjects. Both autistic and…

We examined the validity of the comprehension component of the Gray Oral Reading Test (GORT; Wiederholt & Bryant, 1992, 2001) by assessing whether reading really is required to answer its questions. The extent to which GORT questions are passage independent was assessed by having participants answer them without reading the passages. Most…

This paper compares two methods of establishing content validity, forced-choice judgmental review and a latent category judgmental review. It also compares content validity evidence with the results of a scale reliability analysis and makes recommendations of the two content validity procedures. Two different groups of graduate students enrolled…

An exploratory analysis comparing two test batteries for English-as-a-Foreign-Language reading comprehension used a single framework of communicative language ability and test method facets to investigate construct validity. The framework's use in the content analysis of communicative language tests, and for the comparison of content across tests,…

Reliability and validity of three current instruments (Feminist Identity Scale [FIS], Feminist Identity Development Scale [FIDS]J Feminist Identity Composite [FIC]) used to operationalize Downing and Roush's model of feminist identity development were compared. A sample of 245 women completed all three instruments, and a separate sample of 35…

When the National Assessment of Educational Progress (NAEP) was designed 20 years ago, comparisons among individual states or localities were not deemed desirable. Today, this lack of information to allow comparison is judged to be a serious weakness of the NAEP, and ways to allow comparisons are actively sought. The focus of this paper is to…

Examination boards are often criticized for their failure to provide evidence of comparability across forms, and few such studies are publicly available. This study aims to investigate the extent to which three forms of the General English Proficiency Test Intermediate Speaking Test (GEPTS-I) are parallel in terms of two types of validity…