Presents a comprehensive review of validity that includes an empirical evaluation of the actual and potential consequences of score interpretation and use, how those consequences come about, and what determines them. Six distinguishable aspects of construct validity are highlighted as a means of addressing central issues implicit in the notion of…

Three related Canadian studies assessed the content validity of 59 clinical problems designed as part of a test of medical decision-making skills. Focus was on the key features, i.e., the critical or essential steps in identification and management of the clinical problem. Results support content validity of the key features. (MSE)

This paper focuses on the validity of the research conducted under the leading paradigm in the evaluation of teaching in higher education. Messick's framework on validity is used to identify the strengths and limitations of the research, mostly centered on the study of student ratings of instruction. Critical issues that need to be addressed by…

Objectives: Psychometric properties of the Chinese version of the Interpersonal Reactivity Index (C-IRI) for the assessment of empathy in Chinese people were examined. Method: The Interpersonal Reactivity Index (IRI) was translated to Chinese, and an expert panel reviewed its content validity and cultural relevance. The translated instrument…

Reliability and validity of three current instruments (Feminist Identity Scale [FIS], Feminist Identity Development Scale [FIDS]J Feminist Identity Composite [FIC]) used to operationalize Downing and Roush's model of feminist identity development were compared. A sample of 245 women completed all three instruments, and a separate sample of 35…

Editor-in-Chief James L. Morrison interviews Scott Howell, the co-editor of a three-volume book series entitled "Online Assessment and Measurement" that was published in 2006 by IDEA Group. In discussing his own research, Howell first highlights the value of test blueprints as a valuable tool for ensuring an effective alignment of…

This study was designed to address two frequent criticisms of the SAT essay--that essay length is the best predictor of scores, and that there is an advantage in using more "sophisticated" examples as opposed to personal experience. The study was based on 2,820 essays from the first three administrations of the new SAT. Each essay was…

Based on theories of emotional intelligence, adult education, psychology of reading, and emotions and literature, this study was designed to develop and validate the Affective Response to Literature Survey (ARLS), a psychological instrument used to measure an emotional response to literature. Initially, 27 items were generated by a review of…

Computer-based instruction could have considerable impact on improving the quality of science education. Simulations and interactive problems provide a means for students to explore scientific concepts and experiment without the expense or hazard of using actual materials. This paper focuses on the instructional design process as it relates to the…

A panel of expert referees from the Philadelphia school district categorized items from secondary-level standardized mathematics tests according to National Assessment of Educational Progress (NAEP) subobjectives for mathematics. The following tests were covered by the study: (1) California Achievement Tests (Levels 19 and 20); (2) Comprehensive…

Statewide minimum competency testing programs have emphasized basic skills in reading, mathematics, and writing. However, continuing concerns are expressed in national reports about the level of achievement, particularly in mathematics and science, and increased testing has been suggested as a means of encouraging curriculum change and evaluating…

Michigan is designing a new accountability system that combines high standards and statewide testing within a school accreditation framework. Sound assessment techniques are critical if the accountability system is to provide relevant information to schools and policymakers. One important component of a sound assessment system is measurement of…

Implementing measurement specialists' ideas about content validity with licensure examinations and the problem of court litigation are discussed. Validity issues surfacing when sponsors of national licensure examinations conduct validity investigations are considered. Issues include local versus national focus on content validity, job analysis,…

Item response theory's (IRT) suitability for medical examination data was examined, using data on 2,000 candidates who took the 1980 and 1982 American Board of Internal Medicine Certifying Examinations. Focus was on determining whether the tests met IRT assumptions and applying one-parameter and three-parameter IRT models to the data. (TJH)

As America's public school population becomes more diverse, selecting culturally appropriate instructional materials becomes increasingly important. Though several existing scales assess the quality of curricula materials, most do not consider cultural relevance. The Curricula Appropriateness Scale (CAS) was designed to determine the…