Conducting and publishing rigorous empirical research based on original data is essential for advancing and sustaining high-quality counseling practice. The purpose of this article is to provide a one-stop-shop for writing a rigorous quantitative Methods section in counseling and related fields. The importance of judiciously planning,…

Traditional statistical model evaluation typically relies on goodness-of-fit testing and quantifying model complexity by counting parameters. Both of these practices may result in overfitting and have thereby contributed to the generalizability crisis. The information-theoretic principle of minimum description length addresses both of these…

Assessing sensitivity to unmeasured confounding is an important step in observational studies, which typically estimate effects under the assumption that all confounders are measured. In this paper, we develop a sensitivity analysis framework for balancing weights estimators, an increasingly popular approach that solves an optimization problem to…

The School Survey on Crime and Safety (SSOCS) is managed by the National Center for Education Statistics (NCES) within the Institute of Education Sciences of the U.S. Department of Education. SSOCS collects extensive crime and safety data from principals and administrators of public schools in the United States. Data from this collection can be…

As reporting of effect sizes in evaluation studies has proliferated, researchers and consumers of research need tools for interpreting or benchmarking the magnitude of those effect sizes that are relevant to the intervention, target population, and outcome measure being considered. Similarly, researchers planning education studies with social and…

In institutional research, modern data mining approaches are seldom considered to address predictive analytics problems. The goal of this paper is to highlight the advantages of tree-based machine learning algorithms over classic (logistic) regression methods for data-informed decision making in higher education problems, and stress the success of…

Background: Views can be collected from individuals (self-report) or others on their behalf (proxy-report). Objective: We aimed to review the literature on methods and statistical approaches used to evaluate observer versus self-report responses from individuals with intellectual disability or Down syndrome. Methods: A series of key questions…

Meta-analysis is a widely used methodology to combine evidence from different sources examining a common research phenomenon, to obtain a quantitative summary of the studied phenomenon. In the medical field, multiple studies investigate the effectiveness of new treatments and meta-analysis is largely performed to generate the summary (average)…

Quantitative reasoning (QR) is a key skill for undergraduate biology education. Despite this, many students struggle with QR. Here, we use the theoretical framework of student noticing to investigate why some students struggle with QR in introductory biology labs. Under this framework, what students notice when given new information and data…

This Technical Annex report sets out methodological and technical notes for the 2024 Technical Education Learner Survey. It accompanies two substantive reports -- 'Technical Education Learner Survey 2024: progression of the 2nd T Level cohort' and 'Technical Education Learner Survey 2024: progression of Level 4/5 learners'. The main body of the…

Missing observations are pervasive throughout empirical research, especially in the social sciences. Despite multiple approaches to dealing adequately with missing data, many scholars still fail to address this vital issue. In this article, we present a simple-to-use method for generating multiple imputations (MIs) using a Gaussian copula. The…

This is the fifth in a series of statistical articles for mathematics teachers. In this article the authors discuss graphs for exploring relationships between one categorical variable and one numerical variable using stemplots and boxplots and between two numerical variables, using scatterplots and time series plots. [For "The Data Files 4:…

Research studies in Educational Data Mining (EDM) often involve several variables related to student learning activities. As such, it may be necessary to run multiple statistical tests simultaneously, thereby leading to the problem of multiple comparisons. The Benjamini-Hochberg (BH) procedure is commonly used in EDM research to address this…

This article introduces an open-source software package--R for Qualitative Data Analysis (RQDA). RQDA is an R package for analysis of text-formatted data, which is compatible across operating platforms. It is user-friendly and seamlessly integrates with R, which makes it possible to conduct statistical analyses on qualitative coding. Alternative…

Statistical tests have been an important tool for interpreting the results of research correctly. The factors that influence the determination of the statistical test are research purpose, hypothesis and data. Today, statistical tests are used more frequently, and they aim to analyze whether statistical tests are used in accordance with research.…