ERIC Number: EJ1226366
Record Type: Journal
Publication Date: 2019
Pages: 20
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1380-3611
EISSN: N/A
Available Date: N/A
The Key Role of Representativeness in Evidence-Based Education
Joyce, Kathryn E.
Educational Research and Evaluation, v25 n1-2 p43-62 2019
Within evidence-based education, results from randomised controlled trials (RCTs), and meta-analyses of them, are taken as reliable evidence for effectiveness -- they speak to "what works". Extending RCT results requires establishing that study samples and settings are representative of the intended target. Although widely recognised as important for drawing causal inferences from RCTs, claims regarding representativeness tend to be poorly evidenced. Strategies for demonstrating it typically involve comparing observable characteristics (e.g., race, gender, location) of study samples to those in the population of interest to decision makers. This paper argues that these strategies provide insufficient evidence for establishing representativeness. Characteristics typically used for comparison are unlikely to be causally relevant to all educational interventions. Treating them as evidence that supports extending RCT results without providing evidence demonstrating their relevance undermines the inference. Determining what factors are causally relevant requires studying the causal mechanisms underlying the interventions in question.
Descriptors: Evidence Based Practice, Educational Research, Instructional Effectiveness, Randomized Controlled Trials, Generalizability Theory, Educational Improvement, Validity, Educational Policy, Educational Practices, Inferences, Causal Models
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A