Machine learning (ML) methods for causal inference have gained popularity due to their flexibility to predict the outcome model and the propensity score. In this article, we provide a within-group approach for ML-based causal inference methods in order to robustly estimate average treatment effects in multilevel studies when there is cluster-level…

When meta-analyzing heterogeneous bodies of literature, meta-regression can be used to account for potentially relevant between-studies differences. A key challenge is that the number of candidate moderators is often high relative to the number of studies. This introduces risks of overfitting, spurious results, and model non-convergence. To…

Publication bias is a ubiquitous threat to the validity of meta-analysis and the accumulation of scientific evidence. In order to estimate and counteract the impact of publication bias, multiple methods have been developed; however, recent simulation studies have shown the methods' performance to depend on the true data generating process, and no…

Dominance analysis (DA) is a very useful tool for ordering independent variables in a regression model based on their relative importance in explaining variance in the dependent variable. This approach, which was originally described by Budescu, has recently been extended to use with structural equation models examining relationships among latent…

Meta-analyses of treatment effects in randomized control trials are often faced with the problem of missing information required to calculate effect sizes and their sampling variances. Particularly, correlations between pre- and posttest scores are frequently not available. As an ad-hoc solution, researchers impute a constant value for the missing…

Foundations of statistics research aims to establish fundamental principles guiding inference about populations under uncertainty. It is concerned with the process of learning from observations, notions of uncertainty and induction, and satisfying inferential objectives. The growing interest in predictive methods in high-stakes fields like…

Historically, organizational researchers have fully embraced frequentist statistics and null hypothesis significance testing (NHST). Bayesian statistics is an underused alternative paradigm offering numerous benefits for organizational researchers and practitioners: e.g., accumulating direct evidence for the null hypothesis (vs. 'fail to reject…

We provide a novel characterization of augmented balancing weights, also known as automatic debiased machine learning (AutoDML). These popular "doubly robust" or "de-biased machine learning estimators" combine outcome modeling with balancing weights -- weights that achieve covariate balance directly in lieu of estimating and…

Despite the availability and potential usefulness of demographic and contextual data in many quantitative studies within engineering education, the preference for ANOVA over regression models remains prevalent, often without clear justification. A mapping review of literature from the EJEE and JEE spanning 2012-2022 identified 98 studies using…

Research into statistical learning, the ability to learn structured patterns in the environment, faces a theory crisis. Specifically, three challenges must be addressed: a lack of robust phenomena to constrain theories, issues with construct validity, and challenges with establishing causality. Here, we describe and discuss each issue in relation…

The research of multi-category learning behaviors is a hot issue in interactive learning environment, and there are many challenges in data statistics and relationship modeling. We select the massive learning behaviors data of multiple periods and courses and study the decision application of regression analysis. First, based on the definition of…

Common sense is a dynamic concept and it is natural that our (statistical) common sense lags behind the development of statistical science. What is not so easy to understand is why common sense lags behind as much as it does. We conduct a survey among Japanese students and provide examples and tentative explanations of a number of statistical…

Statistics knowledge, literacy, and skills are vital to undergraduates' academic and professional careers. Students' attitudes toward statistics play a vital role in their understanding of the importance of statistics. Therefore, it is important to examine their attitude toward statistics. This study investigated the attitude of 153 business…

Predictive analytics is widely used in various domains, including education, to inform decision-making and improve outcomes. However, many predictive models are proprietary and inaccessible for evaluation or modification by researchers and practitioners, limiting their accountability and ethical design. Moreover, predictive models are often opaque…

In recent years, the discipline of statistics has begun reckoning with its difficult history. Institutions are reconsidering names that have honored key historical figures in statistics who have deep ties to eugenics movements and racial and class prejudice. These names, however, continue to appear in our classrooms, where we teach the methods…