Evidence-based programs and grassroots programs are often adapted during implementation. Adaptations are often hidden, ignored, or punished. Although some adaptations stem from lack of organizational capacity, evaluators report other adaptations happen in good faith or are efforts to better fit the local context. Program implementers, facilitators…

The PBIS Framework has demonstrated effectiveness in supporting schools in improving various prosocial outcomes including improved social, emotional, and behavioral skills; increased academic outcomes and attendance; decreased exclusionary discipline (e.g., office referrals, suspensions); and reduced reports of bullying and substance abuse. In…

Background: Designed in 2012 with a first implementation in 2013, NE STEM 4U is a professional development program for post-secondary students/undergraduates, and serves as a source of outreach, content knowledge generation, and STEM literacy for youth in grades kindergarten through 8th grade (ages 5-14). The model empowers post-secondary students…

Existing approaches for training paraeducators rely heavily on intensive one-to-one coaching and may not be feasible in practice. In this study, we test a tiered training model in which all paraeducators first received group training, and then coaching was provided only for the subset who did not meet performance criteria after group training.…

Multi-tiered systems of support (MTSS) have been increasingly implemented in schools since the re-authorization of the Individuals with Disabilities Act of 2004 and the Every Student Succeeds Act (ESSA) of 2015. Despite researchers' efforts to identify elements of MTSS--including evidence-based practices, leadership and communication systems and…

Many early childhood programs are not prepared to meet the needs of children who have significant social, emotional, and behavioral challenges. "Program-Wide Supports for Pyramid Model Implementation" (PWS-PMI) provides a systematic approach to supporting early childhood programs using Pyramid Model practices and enhancing children's…

There is increasing evidence supporting the effectiveness of the Early Start Denver Model (ESDM) for children on the autism spectrum. However, substantial variability in response to the ESDM has been reported across participants. We examined the plausible yet untested hypothesis that variations in the fidelity level of therapists delivering the…

Purpose: Using the assessment literacy framework, the purpose of this study was to explore preservice teachers understanding and enactment of the message system during an early field experience. Method: Six PTs employed SE seasons totaling 540 min. Seven qualitative data methods were utilized. Data analysis included deductive and inductive…

This quantitative correlational study dives into the heart of understanding the significance of model fidelity for implementing school threat assessment teams. The target population was instructional staff and threat assessment team members from schools in Dutchess, Putnam, and Westchester Counties in New York State that use the Comprehensive…

The purpose of this study was to examine self-determination outcome data in the year following a one-year cluster randomized controlled trial (C-RCT) comparing the impacts of a "Self-Determined Learning Model of Instruction" (SDLMI) only condition to a SDLMI + "Whose Future Is It?" (SDLMI + WF) condition. Using multilevel…

We developed a six-step iterative process for developing and evaluating a model of implementation fidelity appropriate for use in an instructionally embedded assessment system. Our work explicitly connects the literature on theories of actions for assessment systems with the implementation fidelity literature originating from the program…

The Intercultural Development Research Association (IDRA) was awarded an Education Innovation and Research (EIR) Early Phase grant from the U.S. Department of Education in 2017 to develop, implement, and test a promising program to improve student achievement and educational progress for high-need students: Reenergizing Leadership to Achieve…

Premised on the idea that evaluators should be familiar with a range of approaches to program modifications, I review several existing approaches and then describe another, less well-recognized option. In this newer option, evaluators work with others to identify potentially needed adaptations for select program aspects "in advance." In…

Project/problem-based learning (PBL) can provide an effective model for school reform when implemented with fidelity. In the report, "Rising Above the Gathering Storm," it was recommended that if the U.S. is to remain competitive in the 21st-century economy, there must be a serious effort to "enlarge the pipeline of students who are…

Background: To understand and apply the results of multisite impact studies, it is necessary to know the extent to which the components of an intervention were implemented as they were designed in each context (e.g., Carroll et al., 2007; Hill, Corey, & Jacob, 2018). Rigorous and cost-effective measures of implementation fidelity can help…