In science in general and in the context of single-case experimental designs, replication of the effects of the intervention within and/or across participants or experiments is crucial for establishing causality and for assessing the generality of the intervention effect. Specific developments and proposals for assessing whether an effect has been…

Students' understanding of forces in circular motion is often incomplete. The problems are not limited to confusions about centripetal acceleration and centrifugal forces. This paper considers possible effects of different interventions by a teacher who has discovered the many types of free-body diagrams drawn by students for circular motion in a…

Recent research emphasizes the need for a more sustained interaction of schools with universities and research institutions. For example, informal after-school programs integrated into the school curriculum can provide opportunities for meaningful interaction with researchers in active learning settings. At the physics department of University of…

Urie Bronfenbrenner and Ernest Boyer argued for leaving the laboratory to conduct rigorous developmental research in the real world where children are found--in the places they go. Contributions to this special issue meet Bronfenbrenner and Boyer's call while at the same time recognizing the continued importance of laboratory research. These…

Field experiments, which are a powerful research technique, are common in some fields, but they have not been widely used in studying the effect of financial and counseling planning interventions. Financial services can benefit from the expanded use of field experiments to explore potential causal mechanisms for the effects of financial planning…

Administrative experiments are increasingly available for public programs with high-quality administrative data to identify what changes make programs and services more effective. Program administrators can run short-term experiments to test improvements in programs and have causally valid impact estimates within a year. Administrative experiments…

This article is about designing for educational possibilities--designs that in their inception, social organization, and implementation squarely address issues of cultural diversity, social inequality, and robust learning. I discuss an approach to design-based research, social design experiments, that privileges a social scientific inquiry…

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies. The impact estimators are derived using the building blocks of experimental designs with minimal assumptions, and have good statistical properties. The methods apply to randomized controlled trials (RCTs) and…

Often, in the case of experimental evaluations of multifaceted interventions, researchers and policymakers alike are interested in asking not only whether a given intervention had an effect but also why. They seek answers to questions such as: What features of the intervention led to the impacts that we have observed, or what was the causal…

This chapter presents an introduction to design-based implementation research (DBIR). We describe the need for DBIR as a research approach that challenges educational researchers and practitioners to transcend traditional research/practice barriers to facilitate the design of educational interventions that are effective, sustainable, and scalable.…

Reviewing the studies on differential susceptibility presented in this section, we argue that the time is ripe to go beyond correlational designs to differential susceptibility experiments. In such experiments, randomization prevents hidden moderator effects on the environment and guarantees the independence of moderator and outcome, while the…

Emphasis on neuropsychiatric frameworks of conceptualizing troubled youth is increasing. This focus leads to more biologically-based interventions. As such, the use of psychotropic medications is skyrocketing, while the utilization of psychosocial strategies is diminishing. Yet overall outcomes seem to be faltering. Admissions to outpatient,…

Given scarce resources for evaluation, we recommend that education researchers more frequently conduct comprehensive randomized trials that generate evidence on how, why, and under what conditions interventions succeed or fail in producing effects. Recent experience evaluating a randomized need-based financial aid intervention highlights some of…

Here we report on the successful implementation of an online experimental summary sheet that enabled the continual student monitoring of a large cohort of students undertaking a 6 week enquiry-based laboratory project. Students submitted a weekly research summary that contained information about their data analysis and future experimental plans.…

The aim of this paper is to report on an experiment in the School of Management at the University of Surrey whereby the Scholarship of Teaching and Learning is being promoted through an approach which is organic in nature. The paper argues that the nature of such scholarship means that its promotion is more likely to be successful when the…