Validity is broadly defined as how well something measures what it's supposed to measure. The reliability and validity of scores from assessments are two concepts that are closely knit together and feed into each other.

The content validity ratio (Lawshe) is one of the earliest and most widely used methods for quantifying content validity. To correct and expand the table, critical values in unit steps and at multiple alpha levels were computed. Implications for content validation are discussed. (Contains 2 tables and 1 figure.)

Assessment engineering is a new way to design and implement scalable, sustainable and ideally lower-cost solutions to the complexities of designing and developing tests. It represents a merger of sorts between cognitive task modeling and engineering design principles--a merger that requires some new thinking about the nature of score scales, item…

The main problem of the educational evaluation validity is that it just copies the conceptual framework system of validity from educational measurement to its own conceptual system. The validity conceptual system that fits the need of theory and practice of educational evaluation has not been established yet. According to the inherent attributive…

This paper aims to develop a valid method to assess the key competencies of the exercise physiology profession acquired through work-integrated learning (WIL). In order to develop a competency-based assessment, the key professional tasks needed to be identified and the test designed so students' competency in different tasks and settings could be…

Students tend to believe that RateMyProfessors.com (RMP) is an unfailingly valid measure of teaching effectiveness, and in fact viewing that site prior to taking a course can have a direct influence on their future evaluations of faculty. The authors describe an activity whose objective is to have students analyze different types of validity using…

In September 2011, the New York State Department of Education convened a School and District Accountability Think Tank to provide public input regarding the creation of a second generation educational accountability system for the State's Elementary and Secondary Education Act waiver application. The Asian American Legal Defense and Education Fund…

To address the need for a standardized system to classify the gross motor function of children with cerebral palsy, the authors developed a five-level classification system analogous to the staging and grading systems used in medicine. Nominal group process and Delphi survey consensus methods were used to examine content validity and revise the…

The Philosophies Held by Instructors of Lifelong-learners (PHIL) was developed to identify a respondent's preference for one of the major schools of philosophical thought: Idealism, Realism, Pragmatism, Existentialism, or Reconstructionism. Using the pool of items from an established instrument, its final form and content validity were determined…

The development and validation of the Spanish-English Verbatim Translation Exam (SEVTE) is described. The test is for use by the Federal Bureau of Investigation (FBI) in the selection of applicants for the positions of Language Specialist or Contract Linguist. The report is divided into eight sections. Section 1 describes the need for the test,…

A review of articles in Psychological Assessment reveals that many researchers develop instruments without the benefit of consultation with members of the target population. To the extent that researchers do consult the target population, most fail to bring consultation in early enough to inform the identification and specification of key…

Describes the development of a placement test specifically designed for students entering Pembroke State University. Includes question construction and suitable test standards in discussing the features of a good placement test. Concludes that the test provides a reliable measure of students potential success. (MDH)

With increasing reliance being placed on the results of their surveys, the National Center for Education Statistics (NCES) recognized a need for these survey results to be valid and reliable. As part of the work of the Statistical Analysis Group in Education (SAGE), an effort was undertaken to investigate validity and reliability in survey…

Describes the theoretical framework and practical application of the International Adult Literacy Survey (IALS). Concludes that the survey is based on an empirically-proven statistical construct that has been executed accurately with results that shed light on the relationship between functional literacy and national and individual well being.…

Statewide minimum competency testing programs have emphasized basic skills in reading, mathematics, and writing. However, continuing concerns are expressed in national reports about the level of achievement, particularly in mathematics and science, and increased testing has been suggested as a means of encouraging curriculum change and evaluating…