Evidence-based programs and grassroots programs are often adapted during implementation. Adaptations are often hidden, ignored, or punished. Although some adaptations stem from lack of organizational capacity, evaluators report other adaptations happen in good faith or are efforts to better fit the local context. Program implementers, facilitators…

In recent years, there has been increased attention regarding systems-level implementation to support the sustained use of evidence-based interventions and supports in authentic early childhood settings. With this comes a need to accurately measure implementation fidelity of the critical features within a framework as well as individual practices.…

The purpose of this study was to evaluate the implementation of the "Phonics First"® program within one district to inform district level curriculum team decisions and program planning moving forward. As a level 4 Directed State Support district, the studied district was looking for ways to close the achievement gap and raise overall…

Enhancing student learning, a primary purpose of assessment, can be fostered through integrating modified program theory and implementation fidelity processes into curricular, instructional, and assessment practices. Another assessment priority, reporting student learning outcome results for accreditation which may include inadequate evidence…

With increasing canonicity, particularly within higher education assessment, the demonstrable achievement of goals, or the delivery of a program, or as one scholar wryly deemed it, the "manipulation of the independent variable" (Moncher and Prinz 1991, p. 247), are commonly referred to as implementation fidelity or fidelity of…

Positive behavior support (PBS) is an evidence-based framework for improving quality of life and preventing challenging behavior that is often implemented in combination with person-centered practices in the intellectual and developmental disability (IDD) field. Recently, state agencies and organizations supporting people with IDD have adopted a…

Conducting classroom-based educational research trials is important for establishing the efficacy and effectiveness of specific instructional interventions. Such endeavours, however, are challenging to implement. This was made evident during a recent independent evaluation of the efficacy of the MiniLit program, wherein various difficulties…

Purpose: This paper evaluates the implementation of a school-based physical activity intervention and discusses how the intervention outcomes can be influenced by the implementation. Design/methodology/approach: In four of the nine lower secondary schools in which the intervention was conducted, the authors examined implementation fidelity,…

Treatment fidelity assessment is critical to evaluating the extent to which interventions, such as the Good Behavior Game, are implemented as intended and impact student outcomes. The assessment methods by which treatment fidelity data are collected vary, with direct observation being the most popular and widely recommended. The current study…

This quantitative correlational study dives into the heart of understanding the significance of model fidelity for implementing school threat assessment teams. The target population was instructional staff and threat assessment team members from schools in Dutchess, Putnam, and Westchester Counties in New York State that use the Comprehensive…

The purpose of the "Drivers Best Practices Assessment" ("DBPA") is to assist organizations in assessing their current supports and resources for quality use of selected programs or practices. Specifically, organizations can use it to: (1) Identify strengths and opportunities for improvement in their current supports and…

Fidelity is defined as doing what is intended. The purpose of measuring fidelity is to assist with supporting implementation. Collecting fidelity data provides an opportunity to problem-solve throughout the process versus waiting for outcome data. More often than not, purchased programs and curriculum materials are missing a research-validated…

We sought to identify, examine, and summarize empirical literature focused on early childhood behavior interventions examined using a single case research designs (SCD) and published between 2001 and 2018. Using systematic procedures, 28 studies that met established inclusion criteria were identified, reviewed, and compared with respect to general…

Premised on the idea that evaluators should be familiar with a range of approaches to program modifications, I review several existing approaches and then describe another, less well-recognized option. In this newer option, evaluators work with others to identify potentially needed adaptations for select program aspects "in advance." In…

The foster youth education program strives to increase graduation rates by improving academic performance and encouraging student retention through an innovative collaboration between tutors, social workers, and schools to provide individualized support. The pilot program was funded by U.S. Department of Education Innovation Funds, which evolving…