In qualitative comparative analysis, as with all methods, there is a question about how many cases are needed to make an analysis robust. In deciding on the number of cases, a key consideration is the number of conditions to be analyzed. I suggest that adding cases is preferable to dropping conditions if there are too many conditions relative to…

Learning analytics (LA), like much of machine learning, assumes the training and test datasets come from the same distribution. Therefore, LA models built on past observations are (implicitly) expected to work well for future observations. However, this assumption does not always hold in practice because the dataset may drift. Recently,…

Conventional random-effects models in meta-analysis rely on large sample approximations instead of exact small sample results. While random-effects methods produce efficient estimates and confidence intervals for the summary effect have correct coverage when the number of studies is sufficiently large, we demonstrate that conventional methods…

Team has been widely applied in various fields, in which the collaboration efficiency of a team is the main consideration under the constraints of skill requirements. In educational scenarios, an educational institution usually builds a team of students with different skills to attend a competition, in which team communication cost and team…

Sensitivity analysis, a statistical method crucial for validating inferences across disciplines, quantifies the conditions that could alter conclusions (Razavi et al., 2021). One line of work is rooted in linear models and foregrounds the sensitivity of inferences to the strength of omitted variables (Cinelli & Hazlett, 2019; Frank, 2000). A…

Many students of statistics and econometrics express frustration with the way a problem known as "bad control" is treated in the traditional literature. The issue arises when the addition of a variable to a regression equation produces an unintended discrepancy between the regression coefficient and the effect that the coefficient is…

When designing cluster-randomized trials (CRTs), one important consideration is determining the proper sample sizes across levels and treatment conditions to cost-efficiently achieve adequate statistical power. This consideration is usually addressed in an optimal design framework by leveraging the cost structures of sampling and optimizing the…

Student attitudes are one of the fundamental factors that influence their achievement in the educational context. This study aimed to investigate the psychometric properties of Jordanian university students' attitudes towards blended learning. The sample for the study consisted of 843 Jordanian university students who were enrolled in blended…

This is a practical guide for applying the Impact Threshold for a Confounding Variable and the Robustness of Inference to Replacement using the konfound packages in Stata and R as well as the R-shiny app. It includes motivation worked examples, and tutorials.

Complex Machine Learning (ML) models used to support decision-making in peer-to-peer (P2P) lending often lack clear, accurate, and interpretable explanations. While the game-theoretic concept of Shapley values and its computationally efficient variant Kernel SHAP may be employed for this aim, similarly to other existing methods, the latter makes…

This article uses the interventionist theory of causation, a counterfactual theory taken from philosophy of science, to strengthen causal analysis in process tracing research. Causal claims from process tracing are re-expressed in terms of so-called hypothetical interventions, and concrete evidential tests are proposed which are shown to…

Multidimensional Item Response Theory (MIRT) has been widely used in educational and psychological assessments. It estimates multiple constructs simultaneously and models the correlations among latent constructs. While it provides more accurate results, the unidimensional IRT model is still dominant in real applications. One major reason is that…

Matrix decomposition structural equation modeling (MDSEM) is introduced as a novel approach in structural equation modeling, contrasting with traditional structural equation modeling (SEM). MDSEM approximates the data matrix using a model generated by the hypothetical model and addresses limitations faced by conventional SEM procedures by…

In sparse data meta-analyses (with few trials or zero events), conventional methods may distort results. Although better-performing one-stage methods have become available in recent years, their implementation remains limited in practice. This study examines the impact of using conventional methods compared to one-stage models by re-analysing…

When a researcher proposes an SEM model to explain the dynamics among some latent variables, the real question in model evaluation is the fit of the model's structural part. A composite index that lumps the fit of the structural part and measurement part does not directly address that question. The need for more attention to structural-level fit…