School psychologists have the potential to improve students' reading skills by helping schools select evidence-based programs and then supporting their implementation. Blended learning offers a flexible implementation format to address long-standing challenges implementing and scaling reading programs in schools. The purpose of this study was to…

In 2014, OSEP instituted the Statewide Systemic Improvement Plan (SSIP) reporting requirement. The SSIP was designed as a comprehensive multi-year plan for improving results for infants and toddlers with disabilities and their families through system strengthening efforts. States/entities work to improve their infrastructure, implement…

Systems coaches provide support to teams responsible for improving the implementation of schoolwide service delivery framework such as multitiered system of supports (MTSS). This article first summarizes key findings about what systems coaching is, the goal systems coaches work toward, who these coaches support, and what systems coaches do. The…

This article presents the Renger System Test (RST) as a method for assessing whether a system evaluation approach is suitable for evaluating complex interventions. The RST has three criteria: (1) the intervention includes multiple components, (2) these components operate interdependently, and (3) their interdependence produces an outcome that no…

The Campbellian validity typology has been used as a foundation for outcome evaluation and for developing evidence-based interventions for decades. As such, randomized control trials were preferred for outcome evaluation. However, some evaluators disagree with the validity typology's argument that randomized controlled trials as the best design…

Although teachers' learning has been increasingly recognised as nonlinear and contextually responsive, few studies have extended these understandings to the design and evaluation of professional development. In this case study, we examine nonlinear and contextual manifestations of high school science teachers' professional learning from a complex…

Sustainable community health improvement often requires the implementation of complex interventions in complex systems. Drawing from the "Four Keys to Success" frame (theory, implementation, support, and evaluation), this article describes how we used a formative evaluation approach to foster a learning system capable of monitoring and…

Large-scale education interventions aimed at diminishing disparities and generating equitable learning outcomes are often complex, involving multiple components and intended impacts. Evaluating implementation of complex interventions is challenging because of the interactive and emergent nature of intervention components. Methods that build from…

This article explains and provides the theoretical foundations for and examples of systematization of experiences as a way to plan and evaluate socially engaged university extension programs.

The use of complexity-based evaluation methods remains relatively underexplored in the field of evaluation. While increasingly employed to assess complex interventions, Contribution Analysis (CA) continues to suffer from a lack of operationalization. In this article, we propose enhancing the implementation of CA by leveraging Participatory Systems…

Coaching has been widely implemented to support the delivery of evidence-based practices in schools. Although coaching is effective in rigorous research studies, scholars question the effective translation of coaching in authentic schools. Data systems that monitor the fidelity and impact of coaching offer one solution to address three…

The System Transformation for Equitable Preschools (STEP Forward with Data) Framework was developed to help preschool systems leaders understand where in the preschool system there may be inequities in how children and families are accessing, being supported by, and experiencing the system. The Framework offers preschool systems leaders a pathway…

This paper contends that state bans on Critical Race Theory (CRT) and diversity, equity, and inclusion (DEI) offices are indicative of a broader political agenda to restrict scholarly analyses and practitioner outreach that reveal how societal inequities, policy failures, and racialized deficit framings of marginalized students--not perceived…

The National Academies Global Forum on Innovations in Health Professional Education held a public workshop in November 2023. Speakers explored how health professional educators and providers with health systems science (HSS) training can prepare learners to work together within health systems, resulting in better patient care, improved population…

Although US teenage birth rates substantially decreased over the past two decades, it still remains the highest in the developed world. More innovative, community-wide initiatives are needed to combat the issue. In Oklahoma County, Oklahoma, the Central Oklahoma Teen Pregnancy Prevention Collaboration is utilizing the collective impact model to…