In 2016, the education department at the National Building Museum offered a series of Late Night programs in conjunction with the Summer Block Party installation, ICEBERGS. The museum wanted to evaluate the programs but had limited resources to do so. In the following article, we describe the use of critical appraisal, an economic method applied…

Early math ability is one of the best predictors of children's math and reading skills into late elementary school. Children with stronger math proficiency in elementary school, in turn, are more likely to graduate from high school and attend college. However, early math skills have not historically been a major focus of instruction in preschool…

This report presents findings from exploratory, descriptive meta-analyses of effect sizes reported by the first 82 EEF evaluations that used a randomised controlled trial (RCT) or clustered RCT impact evaluation design published up to January 2019. The review used a theoretical framework derived from literature with five overarching themes to…

This document summarises key findings from the quantitative strands of a review of the Education Endowment Foundation (EEF) evaluations that had reported from the establishment of EEF in 2011 up to January 2019. The quantitative strands summarised include meta-analyses of effect sizes reported for attainment outcomes and descriptive analyses of…

This document provides supplementary statistical tables to support the review of Education Endowment Foundation (EEF) evaluations. This includes: (1) Descriptive (univariate) tables for all explanatory variables; (2) Tables for the meta-analyses of primary ITT effect sizes; (3) Tables for the meta-analyses of secondary ITT effect sizes; (4) Tables…

Treatment effect estimates from a "regression discontinuity design" (RDD) have high internal validity. However, the arguments that support the design apply to a subpopulation that is narrower and usually different from the population of substantive interest in evaluation research. The disconnect between RDD population and the…

The author's goals in this exercise were to use an Excel project to teach students about the effects of changing states of nature on critical path emergence as well as compare the impact of the PERT beta and triangular distributions on project completion times. Previous research into the PERT (program evaluation and review technique) beta…

Academic advising has been researched and linked to student retention and completion in numerous studies. New state initiatives, legislative funding pressure, and financial aid changes have increased pressure on accurate, timely, and intrusive advising to increase timely graduation and student success. As academic advising played a vital role in…

World Education Services (WES) is a non-profit organization with over 40 years of experience in assessing academic credentials from more than 200 countries and jurisdictions and 40,000 educational institutions. Because many refugees are unable to obtain verifiable documents, the assessment of their qualifications calls for a different approach…

The Students Assessing Teaching and Learning (SATAL) Program at the University of California, Merced offers assessment support for faculty and program leads while engaging diverse, cross-program undergraduates in students-as- partners experiences in a work setting. Grounded in the Students as Partners (SaP) principles of respect, responsibility,…

In their National Bureau of Economic Research (NBER) working paper, "Does Gifted Education Work? For Which Students?" Card and Giuliano (C & G) made an enormous splash in not just gifted education but also the world (e.g., "The Washington Post," "The Atlantic," Five Thirty Eight). In this commentary, we highlight…

Programs seeking to challenge and change gender and power relationships require a nimble, evolving monitoring, evaluation, and learning (MEL) system that helps make sense of how nonlinear complex social change happens. This article describes efforts by Oxfam Canada to develop such a system for a women's rights and gender equality program. The…

Purpose: Family support programs commonly use self-sufficiency matrices (SSMs) to measure family outcomes, however, validation research on SSMs is sparse. This study examined the reliability of the Colorado Family Support Assessment 2.0 (CFSA 2.0) to measure family self-reliance across 14 domains (e.g., employment). Methods: Ten written case…

This article presents how character development practitioners, researchers, and funders might think about evaluation, how evaluation fits into their work, and what needs to happen in order to sustain evaluative practices. A broader view of evaluation is presented whereby evaluation is not just seen as something that is applied at a program level,…

HIV continues to significantly impact the health of communities, particularly affecting racially and ethnically diverse men who have sex with men and transgender women. In response, health departments often fund a number of community organizations to provide each of these subgroups with comprehensive and culturally responsive services. To this…