NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
ERIC Number: ED672054
Record Type: Non-Journal
Publication Date: 2022-Jun
Pages: 51
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: 0000-00-00
Design and Analytic Features for Reducing Biases in Skill-Building Intervention Impact Forecasts. EdWorkingPaper No. 22-583
Daniela Alvarez-Vargas; Sirui Wan; Lynn S. Fuchs; Alice Klein; Drew H. Bailey
Annenberg Institute for School Reform at Brown University
Despite policy relevance, longer-term evaluations of educational interventions are relatively rare. A common approach to this problem has been to rely on longitudinal research to determine targets for intervention by looking at the correlation between children's early skills (e.g., preschool numeracy) and medium-term outcomes (e.g., first-grade math achievement). However, this approach has sometimes over--or under--predicted the long-term effects (e.g., 5th-grade math achievement) of successfully improving early math skills. Using a within-study comparison design, we assess various approaches to forecasting medium-term impacts of early math skill-building interventions. The most accurate forecasts were obtained when including comprehensive baseline controls and using a combination of conceptually proximal and distal short-term outcomes (in the nonexperimental longitudinal data). Researchers can use our approach to establish a set of designs and analyses to predict the impacts of their interventions up to two years post-treatment. The approach can also be applied to power analyses, model checking, and theory revisions to understand mechanisms contributing to medium-term outcomes.
Annenberg Institute for School Reform at Brown University. Brown University Box 1985, Providence, RI 02912. Tel: 401-863-7990; Fax: 401-863-1290; e-mail: annenberg@brown.edu; Web site: https://annenberg.brown.edu/
Related Records: EJ1387534
Publication Type: Reports - Research
Education Level: Early Childhood Education; Elementary Education; Grade 1; Primary Education
Audience: N/A
Language: English
Sponsor: Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD) (DHHS/NIH); Institute of Education Sciences (ED); National Science Foundation (NSF), Division of Graduate Education (DGE)
Authoring Institution: Annenberg Institute for School Reform at Brown University
Identifiers - Assessments and Surveys: Wide Range Achievement Test
IES Funded: Yes
Grant or Contract Numbers: R01HD053714; U54HD083211; R305K050004; 1839285
Department of Education Funded: Yes
Author Affiliations: N/A