ERIC Number: EJ1355584
Record Type: Journal
Publication Date: 2022
Pages: 51
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1934-5747
EISSN: EISSN-1934-5739
Available Date: N/A
Heterogeneity in Mathematics Intervention Effects: Evidence from a Meta-Analysis of 191 Randomized Experiments
Williams, Ryan; Citkowicz, Martyna; Miller, David I.; Lindsay, Jim; Walters, Kirk
Journal of Research on Educational Effectiveness, v15 n3 p584-634 2022
Since the standards-based education movement began in the early 1990s, mathematics education reformers have developed and evaluated many interventions to support students in mastering more rigorous content. We conducted a systematic review and meta-analysis of U.S. PreK-12 mathematics intervention effects from 1991 to 2017 to study sources of heterogeneity. From more than 9,000 published and unpublished study reports, we found 191 randomized control trials that met our inclusion criteria, with 1,109 effect size estimates representing more than a quarter of a million students. The average effect size on student mathematics achievement was 0.31, with wide heterogeneity of most effects ranging from -0.60 to 1.23. Two modeling approaches--meta-regression and machine learning--provided converging evidence that outcome measure type (researcher-created vs. standardized) and technology delivery (vs. teacher or interventionist delivery) were predictors of effect size. Intervention type, intervention length, grade level, and publication year were also identified as potentially explanatory factors.
Descriptors: Meta Analysis, Mathematics Education, Educational Change, Difficulty Level, Academic Standards, Intervention, Preschool Education, Elementary Secondary Education, Research Reports, Effect Size, Mathematics Achievement, Research Methodology, Teaching Methods, Predictor Variables, Technology Uses in Education, Instructional Program Divisions, Comparative Analysis
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Information Analyses; Reports - Research
Education Level: Early Childhood Education; Preschool Education; Elementary Secondary Education
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R305A170146
Author Affiliations: N/A