As evidence-based interventions are scaled, fidelity of implementation, and thus effectiveness, often wanes. Validated fidelity measures can improve researchers' ability to attribute outcomes to the intervention and help practitioners feel more confident in implementing the intervention as intended. We aim to provide a model for the validation of…

Pragmatic measures of evidence-based practice (EBP) implementation can support and evaluate implementation efforts. We examined the predictive validity of therapist reports of EBP strategy delivery for children's mental health outcomes. Data were obtained from 1,380 sessions with 248 children delivered by 76 therapists in two county systems.…

Alternative poverty measures have been proposed in response to the emerging insufficiencies of the National School Lunch Program (NSLP) eligibility data. The analysis presented here involves seven poverty measures. Using outcome measures as a yardstick, we can assess how poverty measures explain these outcomes and note variations between…

Alternative poverty measures have been proposed in response to the emerging insufficiencies of the National School Lunch Program (NSLP) eligibility data. The analysis presented here involves seven poverty measures. Using outcome measures as a yardstick, we can assess how poverty measures explain these outcomes and note variations between…

Individual Placement and Support (IPS), an evidence-based supported employment model for working-age adults with serious mental illness, also serves transition age adults (TAY; ages 16-24). The IPS-Y is a new IPS fidelity scale tailored to this younger population. Although adopted worldwide, it lacks research on the psychometric properties of its…

Growth-to-standard models evaluate student growth against the growth needed to reach a future standard or target of interest, such as proficiency. A common growth-to-standard model involves comparing the popular Student Growth Percentile (SGP) to Adequate Growth Percentiles (AGPs). AGPs follow from an involved process based on fitting a series of…

The general feeling is that no predictions can be made based on agent-based social simulations. The outcomes of social simulations are based on the behaviors of individuals and their interactions. Behavioral models are always incomplete and often, also incorrect with respect to real behavior and thus the outcomes of agent-based social simulations…

Medical schools with a diverse student body face the challenge of ensuring that all students succeed academically. Many medical schools have implemented prematriculation programs to prepare students from diverse backgrounds; however, evidence on their impact is largely lacking. In this study, we analyzed participants' demographics as well as the…

This brief provides a summary of the validity of Istation ISIP Early Reading scores in predicting students' performance levels on the Idaho Standards Achievement Test (ISAT) in English language arts (ELA). This correlational study analyzed how well third grade students' winter performance on the ISIP Early Reading test predicted their spring…

Teacher candidate performance assessments represent a promising source of data for evidence-based program improvement. However, teacher preparation programs (TPPs) interested in reform face a crucial question: how to identify actionable evidence in performance-assessment data. To address this concern, we propose a two-pronged empirical framework…

Recent research on entering college student assessment instruments and placement practices has been critical. Critics suggest that commonly used assessment instruments are inaccurate, misused, and lack predictive validity. This article describes valid criticisms and appropriate uses of assessment instruments. It also lists challenges and provides…

This study developed and psychometrically evaluated a brief measure of mental health treatment knowledge (N = 726). Scores from "Knowledge about Treatment" (KaT) demonstrated a unidimensional measure with good model fit, internal consistency reliability, convergent and predictive validity, test-retest reliability, and measurement…

Recruiting and retaining excellent teachers remains a pressing policy issue in education systems worldwide. According to UNESCO estimates, 68.8 million teachers will need to be recruited globally to meet Sustainable Development Goal 4. However, simply recruiting more teachers will not be enough to meet this challenge: we need to recruit…

In-service training is a critical and frequently utilized implementation strategy to support the adoption and delivery of evidence-based practice (EBP) across service settings, but is characteristically ineffective in producing provider behavior changes, particularly when delivered in single exposure didactic events. EBP trainers are in a…

Out-of-school time (OST) youth programs are inherently difficult to assess. They are often very dynamic: Many youth interact with one another and with staff members in various physical environments. Despite the challenge, measuring quality is critical to help program directors and policy makers identify where to improve and how to support those…