This study demonstrates the importance of Rasch Measurement Theory (RMT) in program evaluation when outcome measures need to be constructed from scratch. The paper introduces typical measure validation methods presented in program evaluation texts and discusses room for improvement. The study then illustrates how the seamless transitions from…

This paper reports findings from a project called "The National Panel of Raters" (NPR) that took place within a writing test programme in Norway (2010-2016). A recent research project found individual differences between the raters in the NPR. This paper reports results from an explorative follow up-study where 63 NPR members were…

This report reviews the "Social Skills Improvement System Social-Emotional Learning Edition" (SSIS SEL; Gresham & Elliott, 2017), a multicomponent rating scale that includes a criterion and norm-referenced measure of social-emotional and academic functioning--based on a reformulation of the "Social Skills Improvement…

Educators' interest in technological pedagogical content knowledge (TPACK) has been increasing. In parallel with implementations of TPACK-based activities taking place in different settings, efforts for assessing effectiveness of those activities and understanding the overall TPACK framework have also been under investigation. In this study, the…

The School Counseling Program Report Card--Student Version is a program evaluation tool designed to capture high school student perceptions of school counseling services. This article describes the initial instrument development process. Exploratory factor analysis (N = 305) yielded a 22-item instrument with three subscales that mirror the ASCA…

The Wechsler Preschool and Primary Scale of Intelligence-Fourth Edition: Canadian (WPPSI-IVCDN; Wechsler, 2012), published by NCS Pearson, is a newly updated, individually administered measure of cognitive intelligence for children aged 2:6 through 7:7. Suitable for educational, clinical, and research settings, the purposes of the WPPSI-IVCDN are…

The ARCS Model of Motivational Design has been used myriad times to design motivational instructions that focus on attention, relevance, confidence and satisfaction in order to motivate students. The Instructional Materials Motivation Survey (IMMS) is a 36-item situational measure of people's reactions to instructional materials in the light…

Using graduate social work students' data ("n" = 481) in the Hartford Partnership Program for Aging Education (HPPAE) in the United States, the study examined psychometric properties of the Knowledge of Aging for Social Work Quiz (KASW), a revision of the Facts on Aging Quiz, to evaluate biopsychosocial knowledge relevant to social work.…

The Delis Rating of Executive Function (D-REF) is a set of rating scales designed to assess executive functions and their constituent sub-processes in children and adolescents between the ages of 5 and 18. More specifically, the D-REF is a supplemental assessment of children and adolescents demonstrating behavioral or cognitive difficulties often…

Experiential learning is recommended as a way to increase critical thinking and engagement, enhance theory-informed practice, increase preparedness, and improve multicultural understanding for students involved in social work education. The purpose of this study is to validate the Experiential Learning Survey (ELS), which measures students'…

This article describes the development of the Student Engagement in School Success Skills instrument including item development and exploratory factor analysis. The instrument was developed to measure student use of the skills and strategies identified as most critical for long-term school success that are typically taught by school counselors.

This article draws on previously employed methods for conducting fidelity studies and applies them to an evaluation of an unprescribed intervention. We document the process of assessing the fidelity of implementation of the Math Recovery first-grade tutoring program, an unprescribed, diagnostic intervention. We describe how we drew on recent…

The test review process used by the Buros Center for Testing is described as a series of 11 steps: (1) identifying tests to be reviewed, (2) obtaining tests and preparing test descriptions, (3) determining whether tests meet review criteria, (4) identifying appropriate reviewers, (5) selecting reviewers, (6) sending instructions and materials to…

In joint partnership, Achieve, The Council of Chief State School Officers, and Student Achievement Partners have developed a Toolkit for Evaluating the Alignment of Instructional and Assessment Materials to the Common Core State Standards. The Toolkit is a set of interrelated, freely available instruments for evaluating alignment to the CCSS; each…

In joint partnership, Achieve, The Council of Chief State School Officers, and Student Achievement Partners have developed a Toolkit for Evaluating the Alignment of Instructional and Assessment Materials to the Common Core State Standards (CCSS). The Toolkit is a set of interrelated, freely available instruments for evaluating alignment to the…