Students tend to believe that RateMyProfessors.com (RMP) is an unfailingly valid measure of teaching effectiveness, and in fact viewing that site prior to taking a course can have a direct influence on their future evaluations of faculty. The authors describe an activity whose objective is to have students analyze different types of validity using…

The Buddhist construct of mindfulness is a central element of mindfulness-based interventions and derives from an age-old systematic phenomenological program to investigate subjective experience. Recent enthusiasm for "mindfulness" in psychology has resulted in proliferation of self-report inventories that purport to measure mindful awareness as a…

This article describes how assessments in PE Metrics were developed following six steps: (a) determining test blueprint, (b) writing assessment tasks and scoring rubrics, (c) establishing content validity, (d) piloting assessments, (e) conducting item analysis, and (f) modifying the assessments based on analysis and expert opinion. A task force,…

This article discusses the development of a scale informed by the construct of emotional intelligence designed to measure student development outcomes identified as co-curricular goals. Supervisors, staff, and coaches provided firsthand accounts of student development outcomes at a small, private, liberal arts work college, generating data on…

In this "FastFacts," a state asks the Center on Enhancing Early Learning Outcomes (CEELO) to recommend experts in the field of assessing young children who are English Language Learners (ELL) to train administrators and psychologists working in district preschool programs for young children with special needs? This is particularly…

Life sciences faculty agree that developing scientific literacy is an integral part of undergraduate education and report that they teach these skills. However, few measures of scientific literacy are available to assess students' proficiency in using scientific literacy skills to solve scenarios in and beyond the undergraduate biology classroom.…

In September 2011, the New York State Department of Education convened a School and District Accountability Think Tank to provide public input regarding the creation of a second generation educational accountability system for the State's Elementary and Secondary Education Act waiver application. The Asian American Legal Defense and Education Fund…

The PEDI-CAT is a new computer adaptive test (CAT) version of the Pediatric Evaluation of Disability Inventory (PEDI). Additional PEDI-CAT items specific to postacute pediatric hospital care were recently developed using expert reviews and cognitive interviewing techniques. Expert reviews established face and construct validity, providing positive…

The Berkeley Evaluation and Assessment Research (BEAR) Center at the University of California is developing assessments that are as psychometrically sound as standardized tests and as instructionally relevant as teacher-made, classroom assessments. The BEAR system employs four principles similar to those outlined by the National Research Council:…

Lissitz and Samuelsen (2007) have proposed an operational definition of "validity" that shifts many of the questions traditionally considered under validity to a separate category associated with the utility of test use. Operational definitions support inferences about how well people perform some kind of task or how they respond to some kind of…

To address the need for a standardized system to classify the gross motor function of children with cerebral palsy, the authors developed a five-level classification system analogous to the staging and grading systems used in medicine. Nominal group process and Delphi survey consensus methods were used to examine content validity and revise the…

Teacher education programmes in the United States and in England with early childhood certification usually include courses with topics such as early childhood theory and curriculum, child development, model programs, and history of early childhood education but less often include courses with content focused specifically on advocacy. This article…

The "No Child Left Behind Act" signed into law in 2002 requires school districts to hire highly qualified teachers who possess the necessary dispositions to ensure that all children learn (Center on Education Policy, 2002). The National Council for Accreditation of Teacher Education (NCATE) (2002) defines dispositions as "the values, commitments,…

Item-objective congruence as developed by R. Rovinelli and R. Hambleton is used in test development for evaluating content validity at the item development stage. Provides a mathematical extension to the Rovinelli and Hambleton index that is applicable for the multidimensional case. (SLD)

In this technical report, we describe the development of cognitive diagnostic test items that form the basis of the diagnostic system for Project DIVIDE (Dynamic Instruction Via Individually Designed Environments). The construct underlying the diagnostic test is division of fractions. We include a description of the process we used to identify the…