The success of development projects and evaluations hinges on having access to research protocols and methodologies that consider the needs and characteristics of stakeholders, subjects, and context while remaining rigorous and culturally sound. These efforts are often complicated by a dearth of tools that have been tested for validity and…

This article examines factors that could have influenced whether evaluations of U.S. government--funded foreign assistance programs completed in 2015 had considered unintended consequences. Logit regression models indicate that the odds of considering unintended consequences were increased when all or most of seven standard data collection methods…

This study measures employability following domestic and international internships using a game based analytics tool to predict behaviors associated with employability skills. Exploratory Factor Analysis examined the underlying relationship between 33 behavioral descriptors, which measure skills such as diligence, leadership, learning agility,…

Gender equity is an increasingly discussed priority and cross-cutting theme within international development evaluation. However, it is unclear whether advances being made in evaluating the outcomes in this area are reflected in the scholarly literature. In this context, a fundamental question is: How is gender being addressed in international…

Geographical Olympiads are disciplinary competitions that can be a tool for assessing geographical knowledge and skills in different countries of the world. This article aims to analyse the results of the national and international geography Olympiads and to identify their conditionality and interrelationship. The secondary aim is to find out…

Theory of change (ToC) is currently "the" approach for the evaluation and planning of international development programs. This approach is considered especially suitable for complex interventions. We question this assumption and argue that ToC's focus on cause-effect logic and intended outcomes does not do justice to the recursive nature…

This qualitative case study seeks to understand what 'participatory' in participatory monitoring and evaluation means in an international development context. The objective is to identify the characteristics of a participatory monitoring and evaluation process, according to experts and specialists in the field. The paper seeks to highlight the…

This article presents discussion and recommendations on approaches to retrospectively evaluating development interventions in the long term through a systems lens. It is based on experiences from the implementation of an 18-month study to investigate the impact of development interventions on economic and social change over a 40-year period in the…

This study compares the application of probing techniques in cognitive interviewing (CI) and online probing (OP). Even though the probing is similar, the methods differ regarding typical mode setting, sample size, level of interactivity, and goals. We analyzed probing answers to the International Social Survey Programme item battery on specific…

Using an empirically-based simulation study, we show that typically used methods of choosing an item calibration sample have significant impacts on achievement bias and system rankings. We examine whether recent PISA accommodations, especially for lower performing participants, can mitigate some of this bias. Our findings indicate that standard…

In this paper, we focus on participatory evaluation in the context of international development and specifically on the emerging empirical knowledge base. In a prior review and critique of research on participatory evaluation (Cousins and Chouinard 2012), we examined 121 studies, with only 21 (17%) situated in development contexts. However, the…

Background: Since the late 1970s participatory approaches have been widely promoted to evaluate international development programs. However, there is no universal agreement of what is meant by participatory evaluation. For some evaluators, participatory evaluations involve the extensive participation of all stakeholder groups (from donor to…

Amid growing debates around international assessment tools in educational policy, few have critically examined how students themselves are cast in policy tool production processes and discourse. Drawing on Stuart Hall's concept of representation, we show how higher education (HE) "students" are constructed, fixed and normalized by the…

Participatory evaluation approaches have a relatively long history of advocacy and application in the international development evaluation community. Despite widespread use and apparent resonance with practitioners and donors alike, very little empirical research exists on why and how participatory evaluation approaches are used in international…

At the time of writing, it is not possible to measure progress accurately, or even assess the baseline status of aid effectiveness in the education sector. Twelve targets en route to the five objectives of the Paris Declaration were set and agreed by the Organization for Economic Cooperation and Development (OECD); they were to be measured…