In multisite trials, learning about treatment effect variation across sites is critical for understanding where and for whom a program works. Unadjusted comparisons, however, capture "compositional" differences in the distributions of unit-level features as well as "contextual" differences in site-level features, including…

In multisite trials, learning about treatment effect variation across sites is critical for understanding where and for whom a program works. Unadjusted comparisons, however, capture "compositional" differences in the distributions of unit-level features as well as "contextual" differences in site-level features, including…

This paper reviews the use of multiple trials, defined as multiple sites or multiple arms in a single evaluation and replications, in evaluating social programs. After defining key terms, the paper discusses the rationales for conducting multiple trials, which include increasing sample size to increase statistical power; identifying the most…

Evidence-based health interventions are frequently translated into real-world settings where practical needs drive changes to intervention protocols. Due to logistical and resource constraints, these naturally arising adaptations are rarely assessed for comparative effectiveness using a randomized trial. Nevertheless, when observational data are…

In narrative synthesis of evidence, it can be the case that the only quantitative measures available concerning the efficacy of an intervention is the direction of the effect, that is, whether it is positive or negative. In such situations, the sign test has been proposed in the literature and in recent Cochrane guidelines as a way to test whether…

Purpose: As new technologies such as immersive and augmented platforms emerge, training approaches are also transforming. The virtual reality (VR) platform provides a completely immersive learning experience for simulated training. Despite increased prevalence of these technologies, the extent literature is lagging behind in terms of evaluating…

Research questions regarding how, for whom, and where a treatment achieves its effect on an outcome have become increasingly valued in substantive research. Such questions can be answered by causal moderated mediation analysis, which assesses the heterogeneity of the mediation mechanism underlying the treatment effect across individual and…

Within this "Adult Education Quarterly" ("AEQ") forum, the authors call for a dialogue and examination of research methods in the field of adult and continuing education. Using the article by Boeren as a starting point, the authors analyze both qualitative and quantitative research trends and advocate for more methodological…

Argentina has traditionally stood out in terms of educational outcomes among its Latin American counterparts. Schooling of older children, however, still shows room for improvement especially among the more vulnerable. Fortunately, during the last years a sizeable improvement in attendance rates for children aged 15 through 17 took place. This…

Among econometricians, instrumental variable (IV) estimation is a commonly used technique to estimate the causal effect of a particular variable on a specified outcome. However, among applied researchers in the social sciences, IV estimation may not be well understood. Although there are several IV estimation primers from different fields, most…

Integrating evaluation into an Extension program offers multiple opportunities to understand program success through achieving program goals and objectives, delivering programming using the most effective techniques, and refining program audiences. It is less common that evaluation is used to guide and validate the effectiveness of program…

In 2012, in a bid to improve the quantitative methods training of social science students in the UK, the £19.5 million Q-Step project was launched. This investment demonstrated a significant commitment to changing how we train social science students in quantitative research methods in the UK. The project has involved eighteen higher education…

Proposition 10, also known as the California Children and Families Act of 1998, is the legislation for creating Kern County Children and Families Commission (First 5 Kern). Over the past 15 years, First 5 Kern administered a trust fund from a $.50 per pack tax on cigarettes or equivalent tobacco products to support children ages 0-5 and their…

"The Expanded Success Initiative: Challenges and Progress in the Pursuit of College and Career Readiness for Black and Latino Young Men" synthesizes findings from the Research Alliance's four-year evaluation of Expanded Success Initiative (ESI). This report, draws on hundreds of interviews and focus groups with ESI school leaders,…

The "Tutors@UQ" programme provides an example of a formalised, institution-wide, cross-discipline, academic development programme to enhance the quality of teaching that has been maintained for seven years despite a pattern of substantial organisational change. We present a case study of the programme framed around a four-phase model of…