Experimental studies are often employed to test the effectiveness of teaching innovations such as new pedagogy, curriculum, or learning resources. This article offers guidance on good practice in developing research designs, and in drawing conclusions from published reports. Random control trials potentially support the use of statistical…

Interpretation in cross-language qualitative research presents a range of methodological and ethical challenges. Among these are the interpreters' influence on data generation and interview power dynamics. Having translators review and/or produce an independent translation of recorded interview material for comparative purposes is regarded as one…

We appreciate Barry Cooper and Judith Glaesser's (henceforth CG) energy and effort put into reflecting on parts of our proposals laid out in "Set-theoretic Methods for the Social Sciences" (2012). We use our response to explain what enhanced standard analysis (ESA) is meant to achieve and what not, an issue about which CG hold erroneous…

This paper provides a critical review of Processing Instruction (PI). This type of instructional option was specifically designed to help second/foreign language (L2) learners grasp meaning manifested in the use of particular grammatical forms in a target language effectively through the provision of input. In this way, PI attempts to help…

Background: Stratified medicine seeks to identify patients most likely to respond to treatment. Individual participant data (IPD) network meta-analysis (NMA) models have greater power than individual trials to identify treatment-covariate interactions (TCIs). Treatment-covariate interactions contain "within" and "across" trial…

Situational Teaching plays a crucial role in English classroom teaching in Chinese Primary Schools; hence the relevant research prospers simultaneously. This study is devoted to reveal the research characteristic on English Situational Teaching in Primary Schools in the past 6 years. Result of contrastive analysis and survey of the essays…

Treatment effect estimates from a "regression discontinuity design" (RDD) have high internal validity. However, the arguments that support the design apply to a subpopulation that is narrower and usually different from the population of substantive interest in evaluation research. The disconnect between RDD population and the…

Inferring causal effects of treatments is a central goal in many disciplines. The potential outcomes framework is a main statistical approach to causal inference, in which a causal effect is defined as a comparison of the potential outcomes of the same units under different treatment conditions. Because for each unit at most one of the potential…

We discuss a recent development in the set theoretic analysis of data sets characterized by limited diversity. Ragin, in developing his Qualitative Comparative Analysis (QCA), developed a standard analysis that produces parsimonious, intermediate, and complex Boolean solutions of truth tables. Schneider and Wagemann argue this standard analysis…

Second language (L2) research relies heavily and increasingly on ANOVA (analysis of variance)-based results as a means to advance theory and practice. This fact alone should merit some reflection on the utility and value of ANOVA. It is possible that we could use this procedure more appropriately and, as argued here, other analyses such as…

This paper presents best practices for conducting survey research using Amazon Mechanical Turk (MTurk). Readers will learn the benefits, limitations, and trade-offs of using MTurk as compared to other recruitment services, including SurveyMonkey and Qualtrics. A synthesis of survey design guidelines along with a sample survey are presented to help…

The use of controlled comparisons pervades comparative historical analysis. Heated debates have surrounded the methodological purchase of such comparisons. However, the quality and validity of the conceptual building blocks on which the comparisons are based have largely been ignored. This article discusses a particular problem pertaining to these…

Recent years have shown a rise in the application of serious games used by organizations to help trainees learn and practice job related skills (Muntean, 2011). Some sources have projected a continued growth in the development and application of video games for novel purposes (Sanders, 2015). Despite the increasing use of video games for workplace…

A common argument leveled against charter schools is that they attract the most motivated and intelligent students from already struggling public schools. Marcus Winters seeks to examine this claim, known as "cream-skimming," by comparing the performance of New York City's (NYC) charter middle schools with a set of traditional selective…

Ragin's Qualitative Comparative Analysis (QCA) is often used with small to medium samples where the researcher has good case knowledge. Employing it to analyse large survey datasets, without in-depth case knowledge, raises new challenges. We present ways of addressing these challenges. We first report a single QCA result from a configurational…