Validity is an integrated evaluative judgment of the degree to which empirical evidence and theoretical rationales support the adequacy and appropriateness of interpretations and actions based on test scores or other modes of assessment. The principles of validity apply not just to interpretive and action inferences derived from test scores as…

Test items are designed to be representative of the subject areas that they measure and to reflect the importance of specific domains or item types within those subject areas. Content validity is achieved by content specification and number of items in each content domain included in the design of the test. However, largely due to the normal…

This paper presents a new research instrument, The Lifetime Creativity Scales (LCS), along with validation evidence based on two large and independent samples. Views on creativity are discussed, the background of the LCS is reviewed, and the LCS are briefly described. The seven scales--three measuring peak creativity, three measuring extent of…

Discusses the selection criteria of reinforcement in phonics materials. Reports on a search for phonics materials which met the criteria of having an appropriate amount of reinforcement, high transfer potential, and high content validity. Finds that "Signals Video Learning Series" is a satisfactory phonics program. (MG)

Uses empirical data from an obtrusive study of reference performance to explore the content validity of and assumptions about unobtrusive studies. Changes needed to improve unobtrusive studies of reference services are discussed, including the development of test questions representing all types of queries and supplementing the correct fill rate…

The Student Ideal form of the Adult Classroom Environment scale was administered to 449 adult students and a factor analysis performed. All but 15 of 49 items loaded clearly with a 5-factor orthogonal solution, partially supporting scale's 7 dimensions. A revised scale was administered to 287 students, and another factor analysis largely confirmed…

The Content Validation Form is presented as a means of proving that occupational tests provide a representative work sample or knowledge, skill, or ability necessary for a job. It is best used during test construction by a panel of subject matter experts. (SK)

Reviews recently published methods of assessment of dynamic formulations derived from psychodynamic case material, particularly those that emphasize central maladaptive interpersonal patterns. The methods are divided into those based on case studies and those with a moderate sample size. Psychometric properties are reviewed. The question of how…

Describes research used to develop an original instrument, the Workforce Diversity Questionnaire, to assess interactions in diverse workgroups. States that a set of proposed dimensions was developed theoretically from literature on cultural diversity, discrimination, and intergroup processes. Explains how validity was tested through confirmatory…

A modified Delphi procedure assessed the content validity of accreditation standards for cardiovascular technologists, cytotechnologists, medical sonographers, electroneurodiagnostic technologists, medical assistants, perfusionists, physician assistants, and surgical technologists. Although validity and reliability were extremely high, some…

Three studies examined whether different types of withdrawal among young children could be assessed with a short checklist. In Study 1, kindergarten teachers rated 487 children on a modified version of the Behavior Questionnaire for Two- to Six-Year-Olds (BQTSYO). Exploratory factor analyses yielded 2 withdrawal factors, Social Inhibition and…

Context: A major goal of any evaluation is to demonstrate content validity, which considers both curricular content as well as the ability expected of learners. Whether evaluation blueprints should be published and the degree of blueprint transparency is controversial. Objectives: To examine the effect of blueprint publication on students'…

In recent discussions about educational accountability, participants have joined one of two warring camps. In one corner are the advocates of results-driven accountability who claim that test scores are the most accurate measure of the quality of schools, teachers, and school leaders. In the opposite corner are the advocates of input-driven…

Smart testing is concerned with what is tested and why, whether the testing instruments are up to the task, and how test results are used. Smart testing provides information in a timely fashion, and uses results to make accurate generalizations drawn from the data. This report is concerned with three smart testing components: (1) strong state…

The purpose of this paper is to clarify the seemingly discrepant views of test theorists and test developers about terminology related to the evaluation of test content. The origin and evolution of the concept of content validity are traced, and the concept is reformulated in a way that emphasizes the notion that content domain definition,…