An increased focus on transparency and replication in science has stimulated reform in research practices and dissemination. As a result, the research culture is changing: the use of preregistration is on the rise, access to data and materials is increasing, and large-scale replication studies are more common. In this article, I discuss two…

The redesigned "TOEIC Bridge"® tests were designed to evaluate test takers' English listening, reading, speaking, and writing skills in the context of everyday adult life. In this paper, we summarize the initial validity argument that supports the use of test scores for the purpose of selection, placement, and evaluation of a test…

This article describes and reviews the Singapore-Cambridge General Certificate of Education Advanced Level General Paper (GP) examination. As a written test that is administered to preuniversity students, the GP examination is internationally recognised and accepted by universities and employers as proof of English competence. In this article, the…

Using a multidimensional measure of pay satisfaction, the Pay Satisfaction Questionnaire (PSQ), this study assessed the discriminant validity between scores on a measure of distributive justice and the PSQ with 474 employees. Confirmatory factor analysis results indicate that items from both scales loaded on the hypothesized dimensions. (SLD)

The construct validity of the New Standards middle school Science Reference Examination was studied focusing on evidence related to the internal and external structure of the assessment, the reliability of the assessment scores, and the generalizability of the assessment results. Data for 450 students were taken from the field test in spring 1998.…

Criticizes an article by Messick (1989) that emphasizes consequential validity (the potential and actual social consequences of test score interpretation and use) as a component of construct validity. Shows the profitability of separating the construct-indicator link from the indicator-score link, and the greater importance of the former.…

The concept of "washback," especially prominent in the field of applied linguistics, refers to the extent to which a test influences teachers and learners to do things they would not otherwise necessarily do. Some writers invoke the notion of washback validity, holding that a test's validity should be gauged by the degree to which it has…

In the year 2000, the Alaska High School Graduation Qualifying Examination (HSGQE) was given for the first time. The HSGQE is currently scheduled to be a graduation requirement for all students graduating as of January 2002, but early results from the use of the HSGQE in the Anchorage school district raise serious questions about the use of the…

Making a career choice can be one of the most important decisions in a person's life. Instruments recently developed for use in career counseling have placed an increased emphasis on evaluating career-related beliefs. The purpose of the present study was to evaluate the psychometric characteristics of "Career Beliefs Inventory" scores in…

Reviews new conceptions of cognitive and conative aptitude, learning, development, and achievement and their assessment. Argues that different purposes for educational assessment require different levels and models of assessment. Strongly suggests research on construct validity and teacher understanding and use of assessment. (FMW)

A Swedish empathy test for professional helpers, the Affect Reading Scale, was developed and tested on several occasions with 1000 caregivers in different sectors. Results support the conceptual validity of the scale and demonstrate that it is responsive to educational experiences that influence empathy. (SLD)

This paper addresses the cross-cultural development and use of the Behavior Description Index (BDI). The development of culturally-transportable scales; cross-cultural comparisons of results for 12 Spanish, 15 Hungarian, 15 Indonesian, and U.S. managers; and the transportability of competencies as constructs are considered. A competency is an…

A student perceptions measure of college and university classroom learning environment was developed to reflect the dynamic interplay among contextual variables and accommodates theoretical and practical applications in light of logistical concerns found in such complicated educational settings as a medical school. The 18-item Teaching and…