ERIC Number: EJ1443805
Record Type: Journal
Publication Date: 2024-Sep
Pages: 32
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1098-2140
EISSN: EISSN-1557-0878
Available Date: N/A
Do Social Programs Help Some Beneficiaries More than Others? Evaluating the Potential for Comparison Group Designs to Yield Low-Bias Estimates of Differential Impact
American Journal of Evaluation, v45 n3 p361-392 2024
In the current socio-political climate, there is an extra urgency to evaluate whether program impacts are distributed fairly across important student groups in education. Both experimental and quasi-experimental designs (QEDs) can contribute to answering this question. This work demonstrates that QEDs that compare outcomes across higher-level implementation units, such as schools, are especially well-suited to contributing evidence on differential program effects across student groups. Such designs, by differencing away site-level (macro) effects, on average produce estimates of the differential impact that are closer to experimental benchmark results than are estimates of average impact based on the same design. This work argues for the importance of routine evaluation of moderated impacts, describes the differencing procedure, and empirically tests the methodology with seven impact evaluations in education. The hope is to encourage broader use of this design type to more-efficiently develop the evidence base for differential program effects, particularly for underserved students.
Descriptors: Students, Program Evaluation, Social Development, Social Bias, Minority Group Students, Political Influences, Equal Education, Inclusion, Evaluation Methods, Outcome Measures, Comparative Testing, Educational Benefits
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub-com.bibliotheek.ehb.be
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A