The purpose of this study was to develop a reliable and valid rating scale for the use of the assessment and evaluation of lesson plans and teaching practices that are based on argumentation-based inquiry (ABI). The study covered two academic years (four academic semesters). Qualitative and quantitative methods were utilized throughout the…

This study investigated the use of brief observations to measure implementation of small group interventions using the Quality of Intervention Delivery and Receipt (QIDR) tool. Videos of 10-min segments representing the beginning, middle, and end of each 30-min intervention lesson were coded for implementation. Results indicated that (a)…

We revisit the merits of the retrospective pretest-posttest (RPP) design for repeated-measures research. The underutilized RPP method asks respondents to rate survey items twice during the same posttest measurement occasion from two specific frames of reference: "now" and "then." Individuals first report their current attitudes…

Research Findings: The present study provides an initial descriptive comparison of the Early Childhood Environment Rating Scale-Revised (ECERS-R) and the Early Childhood Environment Rating Scale-Third Edition (ECERS-3) in a relatively large sample in 1 state that uses the Environment Rating Scales within its Quality Rating and Improvement System…

Four rating scales for accessing aspects of early childhood education and care programs' quality were employed for the present study. The aim of the study was to examine scales' reliability by using them in one preschool and one infant/toddler classroom during the course of a week. Research results suggest that early childhood education and care…

Out-of-school time (OST) youth programs are inherently difficult to assess. They are often very dynamic: Many youth interact with one another and with staff members in various physical environments. Despite the challenge, measuring quality is critical to help program directors and policy makers identify where to improve and how to support those…

Because of the critical function of the IEP in the planning and implementation of effective instruction for students with disabilities, educators need a reference to determine the standards of a quality IEP and a process by which to compare an IEP to those standards. A rubric can support educators in examining the quality of IEPs. This study used…

Leaders, policymakers, and systems developers seek to improve early childhood programs through data driven decision-making. Data can be useful for informing continuous quality improvement efforts at the classroom and program level and for creating support for workforce development at the system level. Early childhood program leaders use…

Austin Independent School District (AISD) Social Emotional Learning (SEL) coaches rated schools on the degree to which they implemented 10 domains believed to best exemplify program goals. This study examines the validity and reliability of the implementation rubric they used. A separate full report also was published. [For the full report, see…

Evaluations of teacher preparation programs (TPPs) based in part on the performance of program completers have emerged as an education reform strategy in several states and have become central features of the Race to the Top (RTTT) grant competition. The objective of this policy review is to examine how the state of Tennessee measured and reported…

Due to the growing importance of the professional role of teachers, effective evaluation practices are essential to ensuring highly qualified educators. The problem addressed was how Volusia County School teachers in the state of Florida experienced the teacher evaluation process and how that impacted the effectiveness of instructional practices…

Austin Independent School District (AISD) Social Emotional Learning (SEL) coaches rated schools on the degree to which they implemented 10 domains believed to best exemplify program goals. This study examines the validity and reliability of the implementation rubric they used. A separate research brief report also was published. [For the research…

Core competencies essential for effective teaching were identified via a literature review and a review of standards for teacher education, and vetted by state groups with interests in teacher education. Survey items based on these competencies asked teacher candidates, graduates, and teacher education program faculty how well the program prepared…

Background: Stakeholder participation is an important trend in the field of program evaluation. Although a few measurement instruments have been proposed, they either have not been empirically validated or do not cover the full content of the concept. Objectives: This study consists of a first empirical validation of a measurement instrument that…

Background: Youth programs often rely on self-reported data without clear evidence as to the accuracy of these reports. Although the validity of self-reporting has been confirmed among some high school and college age students, one area that is absent from extant literature is a serious investigation among younger children. Moreover, there is…