Researchers increasingly have access to two types of data: (i) large observational datasets where treatment (e.g., class size) is not randomized but several primary outcomes (e.g., graduation rates) and secondary outcomes (e.g., test scores) are observed and (ii) experimental data in which treatment is randomized but only secondary outcomes are…

In this article, the authors address some of the scientific challenges associated with using observation as a research method. The authors ask how researchers contextualise and understand observation in terms of its theoretical underpinnings and how it is conducted. Using a vignette in the kindergarten context, the authors explore how observation…

In the early months of the COVID-19 pandemic, many research funding organizations were faced with the choice of suspending their peer review panels, or else continuing their decision-making processes virtually. Although seen part of a longer drive to make peer review more cost and time efficient as well as to combat climate and sustainability…

In this article, we reflect on our experiences with teaching ethnographic skills and sensibilities to MSc students at a Dutch university. Using methods such as (self)observation, journaling and reflection, we highlight dilemmas (conceptual, practical, ethical) faced by students when doing ethnographic fieldwork and dilemmas that emerged in…

This paper explores the challenges of filming as a qualitative research method in practical school subjects. We exemplify with an observation study using video data collected from lessons in Home Economics, but the issues we discuss are also relevant for other subjects with practical elements, such as Arts, Crafts, Music, Physical Education, and…

The growing interest in video research and new technologies for recording human interaction has stirred debates about intrusiveness and 'reactivity' understood as researcher-derived changes in subjects. In addition to a plethora of concepts referring to such effects in extant literature, different ontological and epistemological positions provide…

Context: A perennial problem in applied statistics is the inability to justify strong claims about cause-and-effect relationships without full knowledge of the mechanism determining selection into treatment. Few research designs other than the well-implemented random assignment study meet this requirement. Researchers have proposed partial…

The National Institute of Mental Health created the National Database for Autism Research (NDAR) to accelerate autism knowledge through data sharing and collaboration. However, our experience using NDAR reveals systematic challenges across several aspects of data submission, selection, management, and analysis that limit utility of this resource.…

In the complex world of educational policy, causal inferences will be debated. As we review non-experimental designs in educational policy, we focus on how to clarify and focus the terms of debate. We begin by presenting the potential outcomes/counterfactual framework and then describe approximations to the counterfactual generated from the…

This research note offers a critical reflection of the process of conducting qualitative research in the Irish primary school setting. The research discussed took place during the school year 2016-2017. It explored primary school children's understandings of citizenship and, the kinds of collective social actions they participated in as citizens…

Much contemporary ethnography hopes to engage with a community to justify social critique. Whether from problem selection, interpersonal rewards, or a desire for exchange, researchers often take the "side" of informants. Such an approach, linked to "public ethnography," marginalizes a once-traditional approach to fieldwork,…

This article examines the practices of ethnographers carrying out research in and, especially, on organizations. Ethnographers studying organizations, like other ethnographers, emphasize close observation and understanding the meaning of actions, words, and artifacts; they differ from other fieldworkers, though, in focusing on the organization…

This paper proposes a strategy for ethnographically investigating politically disparate education organizations. I develop the notion of researching as a critical secretary: a method of participant-observation conducted alongside those observed to hold the least formal power. Drawing on data from an initial empirical effort to implement this…

Familiarity and distance is an issue that is much discussed in ethnographic fieldwork. This paper focuses on the topic of balancing familiarity and distance when the researcher is directly or indirectly part of the field, which in the study consists of an adult education context of two different teacher-training courses for upper secondary…

This article focuses on methodological and epistemological issues arising from a research project with two Gypsy communities (2010-2012) in the South West of England. Although the two communities seem to share cultural roots and values, and live within a few miles of each other, they have contrasting experiences within the education system and…