To design effective instruction, educators need to know "what" design strategies are generally effective and why these strategies work, based on the mechanisms through which they operate. Experimental comparison studies, which compare one instructional design against another, can generate much needed evidence in support of effective…

Although there is an extensive methodological literature on the measurement of intergenerational income mobility, there has been limited research on the conceptual interpretation of mobility measures and the methodological implications of those interpretations. In this article, I focus on the three measures of mobility most frequently used in the…

Multilevel factor mixture modeling (FMM) is a hybrid of multilevel confirmatory factor analysis (CFA) and multilevel latent class analysis (LCA). It allows researchers to examine population heterogeneity at the within level, between level, or both levels. This tutorial focuses on explicating the model specification of multilevel FMM that considers…

This article provides clear and practical guidelines for researchers seeking to use national secondary datasets to conduct evidence-based research. Drawing from our own experiences, we discuss a six-step research process model (Bryan et al., 2010, 2017) to help researchers navigate the use of these datasets. We present examples from the school…

There is a longstanding debate on whether the analysis of covariance (ANCOVA) or the change score approach is more appropriate when analyzing non-experimental longitudinal data. In this article, we use a structural modeling perspective to clarify that the ANCOVA approach is based on the assumption that all relevant covariates are measured (i.e.,…

We describe a hands-on project in which students collect data on the impact of distracted driving on driver reaction time. Initially they do this in class via a virtual driving applet, using themselves and fellow students as test subjects. Different applet versions simulate driving with and without distraction and measure the time it takes to…

In today's data-driven and data-informed educational landscape, leaders face increasing pressure to make decisions and present results based on what appear to be comprehensive statistical analyses. However, the ethical implications of these responsibilities can be complex, particularly when statistical results carry the potential to be…

This guide offers a comprehensive handbook to scientific research methodology and experimental design, specifically for novice MA and PhD researchers in Education and Language Learning (TESOL/TEFL). It establishes scientific research as a systematic, objective inquiry focused on identifying cause-and-effect relationships through empirical data.…