Researchers and research organizations are under increasing pressure to demonstrate that their work contributes to positive change and helps solve pressing societal challenges. There is a simultaneous trend towards more engaged transdisciplinary research that is complexity-aware and appreciates that change happens through systems transformation,…

Since 2007, two taxonomies have been proposed to identify the components of evaluation practice that may be specified in an evaluation policy. Little is known, however, about how these taxonomies align with evaluation policies developed by philanthropic foundations. Through thematic analysis, this article first compares 12 foundation evaluation…

In this manuscript, we describe a coding club we created and implemented during the COVID-19 pandemic. We were purposeful in creating the club to: (a) focus on design and problem solving as the basis for learning computer coding and (b) include elements to improve the engagement of girls. We ran multiple iterations of a Girls Design with Code Club…

The Campbellian validity typology has been used as a foundation for outcome evaluation and for developing evidence-based interventions for decades. As such, randomized control trials were preferred for outcome evaluation. However, some evaluators disagree with the validity typology's argument that randomized controlled trials as the best design…

Many seem to believe that researcher-made tests are unnecessary, if not inappropriate, for evaluating reading comprehension interventions. We suggest that this view reflects a zeitgeist in which researcher-made (proximal) tests that align with the researchers' interventions are closely scrutinized and often devalued, whereas commercially developed…

The U.S. Department of Education (Education) plays a key role in supporting educational opportunities for K-12 students, including awarding grants and overseeing compliance with federal education laws. Over the past decade, Education's grant awards have generally increased in number and size. Using Education budget data, it was determined that in…

Assessment validity, reliability, and constructive alignment to planned learning outcomes are less understood in the context of integrated, problem-based curricula. This conceptual paper examines a Triple Jump Assessment (TJA) employed as a formative and summative assessment system in the first year of an undergraduate dental program.…

Despite political and rhetorical pronouncements of a reduction in racism, growing inequity in U.S. society continues to feature race as a prominent fault line with no evidence of reduction on the horizon. Of significant concern is the degree to which inequity among racially identified subgroups of the population link to policies and practices of…

A recent paper uses Bayes factors to argue a large minority of rigorous, large-scale education RCTs are "uninformative." The definition of "uninformative" depends on the authors' hypothesis choices for calculating Bayes factors. These arguably overadjust for effect size inflation and involve a fixed prior distribution,…

Adult basic education (ABE) policies aim to help adults improve their literacy, numeracy and information and communications technology skills, as well as their qualifications, often in pursuit of economic gains such as better employment and earnings. The large-scale improvement of skills and qualifications has been referred to as a wicked policy…

Active learning promotes the capacity of problem solving and decision making among learners. Teachers who apply instructional processes toward active participation of learners help their students develop higher order thinking skills. Due to the recent paradigm shift toward adopting competency-based curricula in the education of healthcare…

The "Promoting Alternative THinking Strategies (PATHS®)" program is a curriculum that aims to promote emotional and social competencies and to reduce aggression and behavior problems in elementary school children. "PATHS"® is delivered through short lessons given two to three times a week over the school year. The program is…

Over the last years, "El Sistema" has been enthusiastically received around the world and has inspired several proposals aiming to transplant it to different contexts in different countries. It would seem, then, that "El Sistema" constitutes a renewed approach that allows a place for inclusive music education within the…

The field of Adult Literacy and Numeracy (ALN) has an evidence problem. This paper analyses that problem through the lens of three overarching types of evidence available to researchers and policymakers: Type 1 evidence, which provides descriptions of the scope of social problems; Type 2 evidence measuring the impacts of programmes addressing…

London Bubbles Speech Bubbles programme supports young children who are struggling to communicate in the classroom. This paper describes the slew of evaluation and research that has been undertaken on the project and explores some of the learning that has happened as we have moved out of our comfort zone of qualitative approaches to evaluation to…