Researchers increasingly have access to two types of data: (i) large observational datasets where treatment (e.g., class size) is not randomized but several primary outcomes (e.g., graduation rates) and secondary outcomes (e.g., test scores) are observed and (ii) experimental data in which treatment is randomized but only secondary outcomes are…

In this article, the authors address some of the scientific challenges associated with using observation as a research method. The authors ask how researchers contextualise and understand observation in terms of its theoretical underpinnings and how it is conducted. Using a vignette in the kindergarten context, the authors explore how observation…

The growing interest in video research and new technologies for recording human interaction has stirred debates about intrusiveness and 'reactivity' understood as researcher-derived changes in subjects. In addition to a plethora of concepts referring to such effects in extant literature, different ontological and epistemological positions provide…

Context: A perennial problem in applied statistics is the inability to justify strong claims about cause-and-effect relationships without full knowledge of the mechanism determining selection into treatment. Few research designs other than the well-implemented random assignment study meet this requirement. Researchers have proposed partial…

Much contemporary ethnography hopes to engage with a community to justify social critique. Whether from problem selection, interpersonal rewards, or a desire for exchange, researchers often take the "side" of informants. Such an approach, linked to "public ethnography," marginalizes a once-traditional approach to fieldwork,…

The National Institute of Mental Health created the National Database for Autism Research (NDAR) to accelerate autism knowledge through data sharing and collaboration. However, our experience using NDAR reveals systematic challenges across several aspects of data submission, selection, management, and analysis that limit utility of this resource.…

In the complex world of educational policy, causal inferences will be debated. As we review non-experimental designs in educational policy, we focus on how to clarify and focus the terms of debate. We begin by presenting the potential outcomes/counterfactual framework and then describe approximations to the counterfactual generated from the…

This article examines the practices of ethnographers carrying out research in and, especially, on organizations. Ethnographers studying organizations, like other ethnographers, emphasize close observation and understanding the meaning of actions, words, and artifacts; they differ from other fieldworkers, though, in focusing on the organization…

Familiarity and distance is an issue that is much discussed in ethnographic fieldwork. This paper focuses on the topic of balancing familiarity and distance when the researcher is directly or indirectly part of the field, which in the study consists of an adult education context of two different teacher-training courses for upper secondary…

Prompted by discovering a paper written in 1980 which described a process of 'ethnography by proxy', I revisit this concept in the light of two research projects: a workplace study of an electronics company conducted in the early 1990s and a later home-based study of young children's encounters with toys and technology. The paper defines…

The work presented in this case study results from a study conducted in 2012-2014 examining a newly created teacher evaluation system to determine the inter-rater reliability of the classroom observation instrument. The teacher evaluation system was the result of a partnership between the school district and the university in the same city…

Mobile technologies, specifically smartphones, offer social scientists a potentially powerful approach to examine the social world. They enable researchers to collect information that was previously unobservable or difficult to measure, expanding the realm of empirical investigation. For research that concerns resource-poor and hard-to-reach…

Ethnographic research is an emerging research technique in the field of education. Ethnographic research was a procedure usually used in anthropology but now it is getting popular in educational field. This kind of research relies on qualitative data, its perspective is holistic and its procedures of data analysis involve contextualization. Data…

The author raises questions about ethnographic methodology through exploring the implications of using observations produced by his colleagues about his office as data for his research. This process blurred the boundaries between researcher, method and the object and subject of research. It meets some criteria for ethnography and not others, and…

This paper describes two researchers engagement with two teachers as they taught a middle grades mathematics course, Current Events Math, in a large urban school district. The researchers share bits of data and their ethical entanglements as they entered into the site to find the truth about what works in middle grades mathematics classrooms only…