This study demonstrates the importance of Rasch Measurement Theory (RMT) in program evaluation when outcome measures need to be constructed from scratch. The paper introduces typical measure validation methods presented in program evaluation texts and discusses room for improvement. The study then illustrates how the seamless transitions from…

This report reviews the "Social Skills Improvement System Social-Emotional Learning Edition" (SSIS SEL; Gresham & Elliott, 2017), a multicomponent rating scale that includes a criterion and norm-referenced measure of social-emotional and academic functioning--based on a reformulation of the "Social Skills Improvement…

The School Counseling Program Report Card--Student Version is a program evaluation tool designed to capture high school student perceptions of school counseling services. This article describes the initial instrument development process. Exploratory factor analysis (N = 305) yielded a 22-item instrument with three subscales that mirror the ASCA…

This article draws on previously employed methods for conducting fidelity studies and applies them to an evaluation of an unprescribed intervention. We document the process of assessing the fidelity of implementation of the Math Recovery first-grade tutoring program, an unprescribed, diagnostic intervention. We describe how we drew on recent…

The test review process used by the Buros Center for Testing is described as a series of 11 steps: (1) identifying tests to be reviewed, (2) obtaining tests and preparing test descriptions, (3) determining whether tests meet review criteria, (4) identifying appropriate reviewers, (5) selecting reviewers, (6) sending instructions and materials to…

In joint partnership, Achieve, The Council of Chief State School Officers, and Student Achievement Partners have developed a Toolkit for Evaluating the Alignment of Instructional and Assessment Materials to the Common Core State Standards. The Toolkit is a set of interrelated, freely available instruments for evaluating alignment to the CCSS; each…

In joint partnership, Achieve, The Council of Chief State School Officers, and Student Achievement Partners have developed a Toolkit for Evaluating the Alignment of Instructional and Assessment Materials to the Common Core State Standards (CCSS). The Toolkit is a set of interrelated, freely available instruments for evaluating alignment to the…

This article addresses the leadership preparation line of inquiry developed in the past decade by the University Council for Educational Administration/Learning and Teaching in Educational Leadership Special Interest Group Taskforce on Evaluating Leadership Preparation Programs, and it particularly addresses the series of survey instruments…

Life sciences faculty agree that developing scientific literacy is an integral part of undergraduate education and report that they teach these skills. However, few measures of scientific literacy are available to assess students' proficiency in using scientific literacy skills to solve scenarios in and beyond the undergraduate biology classroom.…

The educational system perpetuates social injustice through structural inequities of assessment and evaluation. High-stakes standardized testing has a destructive effect on teaching and learning that affects all students, teachers, and schools; it is particularly damaging for disadvantaged students--minorities, students with disabilities, students…

The "PISA 2009 Technical Report" describes the methodology underlying the PISA 2009 survey. It examines additional features related to the implementation of the project at a level of detail that allows researchers to understand and replicate its analyses. The reader will find a wealth of information on the test and sample design,…

Purpose: The purpose of this paper is to describe a theoretically based coding framework for an integrated analysis and assessment of critical thinking in online discussion. Design/methodology/approach: The critical thinking assessment framework (TAF) is developed through review of theory and previous research, verified by comparing results to…

This invited special issue of "Early Education and Development" presents research related to the Early Development Instrument (EDI; Janus & Offord, 2007), a community tool to assess children's school readiness at a population level. In this editorial introduction, we first sketch out recent trends in school readiness research that call for a…

In early intervention, researchers often are interested in interpretation aids that can help determine the relative importance of variables when multiple regression models are used, and that facilitate deeper insight into prediction dynamics. Commonality analysis is one approach for helping researchers understand the contributions independent or…

This paper describes the development of an instrument--The Reflective Supervisor Questionnaire (RSQ). The RSQ maps the domain of research supervisory practice as a facilitative process involving educational tasks and activities. It is designed to assist research supervisors explore, by means of self-reflection and reflection on feedback from…