Common sense is a dynamic concept and it is natural that our (statistical) common sense lags behind the development of statistical science. What is not so easy to understand is why common sense lags behind as much as it does. We conduct a survey among Japanese students and provide examples and tentative explanations of a number of statistical…

This study explores various approaches to investigate participants' testing performance and learning behaviors in a computer-based spatial rotation learning program. Using multivariate learning and assessment data, including responses, response times, learning times and selected covariates, a comprehensive data analytic framework is developed that…

Given recent evidence challenging the replicability of results in the social and behavioral sciences, critical questions have been raised about appropriate measures for determining replication success in comparing effect estimates across studies. At issue is the fact that conclusions about replication success often depend on the measure used for…

Cluster-randomized trials have been widely used to evaluate the treatment effects of interventions on student outcomes. When interventions are implemented by teachers, researchers need to account for the nested structure in schools (i.e., students are nested within teachers nested within schools). Schools usually have a very limited number of…

We propose new ways of robustifying goodness-of-fit tests for structural equation modeling under non-normality. These test statistics have limit distributions characterized by eigenvalues whose estimates are highly unstable and biased in known directions. To take this into account, we design model-based trend predictions to approximate the…

There is a longstanding debate on whether the analysis of covariance (ANCOVA) or the change score approach is more appropriate when analyzing non-experimental longitudinal data. In this article, we use a structural modeling perspective to clarify that the ANCOVA approach is based on the assumption that all relevant covariates are measured (i.e.,…

This paper emphasizes the divergences in quantitative and qualitative methodological approaches when exploring trust relationships in school units. We focus on how participants responded and how the results were interpreted. This study, based on such design, questionnaires, and semi-structured interviews to understand trust among teachers and…

The research presented in this Case Study examines adjunct faculty satisfaction at an online public institution of higher education. Specifically, I analyzed student-, individual-, and institution-related factors of faculty satisfaction based on a previously constructed survey instrument found in the literature. While carrying out the research,…

We examine the meanings students give to points when they are graphing relationships between quantities in dynamic, experiential contexts. Using data from teaching experiments with middle-grades students, we illustrate two main categories of meanings: iconic and quantitative. We then introduce four distinct subcategories of meanings: (a) iconic…

In education settings, treatments are often non-randomly assigned to clusters, such as schools or classrooms, while outcomes are measured for students. This research design is called the clustered observational study (COS). We examine the consequences of common support violations in the COS context. Common support violations occur when the…

How can we measure the resource mobilization (RM) efforts of social movements on Twitter? In this article, we create the first ever measure of social movements' RM efforts on a social media platform. To this aim, we create a four-conditional lexicon that can parse through tweets and identify those concerned with RM. We also create a simple RM…

Previous research extensively studied reasons for and ways to avoid low response rates, but it largely ignored the primary research issue of the degree to which response rates matter, which we address. Methodological survey research on response rates has been concerned with how to increase responsiveness and with the effects of response rates on…

In the article, we focused on the issues of measurement error and omitted confounders while conducting mediation analysis under experimental studies. Depending on informativeness of the confounders between the mediator (M) and outcome (Y), we described two approaches. When researchers are confident that primary confounders are included (e.g.,…

To meet accreditation expectations, teacher preparation programs must demonstrate their candidates are evaluated using summative assessment tools that yield sound, reliable, and valid data. These tools are primarily used by the clinical experience team -- university supervisors and mentor teachers. Institutional beliefs regarding best practices…

Education research has recently seen the emergence of two distinct frameworks guiding the application of quantitative methods through a more critical and equity-oriented lens. These two frameworks are critical quantitative (CritQuant) studies and quantitative critical race theory (QuantCrit). Although different in their intellectual traditions,…