This article presents methods for using extant data to improve the properties of estimators of the standardized mean difference (SMD) effect size. Because samples recruited into education research studies are often more homogeneous than the populations of policy interest, the variation in educational outcomes can be smaller in these samples than…

This article provides clear and practical guidelines for researchers seeking to use national secondary datasets to conduct evidence-based research. Drawing from our own experiences, we discuss a six-step research process model (Bryan et al., 2010, 2017) to help researchers navigate the use of these datasets. We present examples from the school…

This study demonstrates how to evaluate a university-wide online course designed to support student transition into university by using Propensity Score Matching (PSM) and Doubly Robust Estimation (DRE). Using data from seven academic years, from 2016/17 to 2022/23, with more than 28,000 students, we examine whether enrolment in this optional…

This article presents methods for using extant data to improve the properties of estimators of the standardized mean difference (SMD) effect size. Because samples recruited into education research studies are often more homogeneous than the populations of policy interest, the variation in educational outcomes can be smaller in these samples than…

Providing a rich context has become a sine qua non of principled teaching of applied statistical thinking. With increasing opportunities to access secondary data, there should be increasing opportunity to work with rich context. We review the contextual information provided in 41 data sets suitable for introductory tertiary statistics teaching,…

In today's era of large-scale data, academic institutions, businesses, and government agencies are increasingly faced with heterogeneous datasets. Consequently, there is a growing need to develop effective methods for extracting meaningful insights from this type of data. Quantile, expectile, and expected shortfall regression methods offer useful…

Research designs that include planned missing data are gaining popularity in applied education research. These methods have traditionally relied on introducing missingness into data collections using the missing completely at random (MCAR) mechanism. This study assesses whether planned missingness can also be implemented when data are instead…

As the use of data in courses that incorporate statistical methods has become more prevalent, so has the need for tools for working with such data, including those for data creation and adjustment. While numerous tools exist that support faculty who teach statistical methods, many are focused on data analysis or theoretical concepts, and there…

This study elaborates on the pivotal roles of mathematical and statistical models in data-driven predictions in an integrated STEM context using the case of Year 4 students: (?) "a descriptive means" to describe the features of trends and variability of data and (?) "an explanatory means" to explain causal relationships behind…

In today's data-driven and data-informed educational landscape, leaders face increasing pressure to make decisions and present results based on what appear to be comprehensive statistical analyses. However, the ethical implications of these responsibilities can be complex, particularly when statistical results carry the potential to be…

This article introduces the concept of the carrying capacity of data (CCD), defined as an integrated, evaluative judgment of the credibility of specific data-based inferences, informed by quantitative and qualitative analyses, leavened by experience. The sequential process of evaluating the CCD is represented schematically by a framework that can…

In this study, we propose a MOOC Analytic Statistical Visual model (MOOC-ASV) to explore students' engagement in MOOC courses and predict their performance on the basis of their behaviors logged as big data in MOOC platforms. The model has multifunctions, which performs on visually analyzing learners' data by state-of-the-art techniques. The model…

Classification and Regression Tree (CART) analysis is a statistical modeling approach that uses quantitative data to predict future outcomes by generating decision trees. CART analysis can be useful for educators to inform their decision-making. For example, educators can use a decision tree from a CART analysis to identify students who are most…

This paper provides introductory statistics instructors with the capacity to use engaging National Basketball Association (NBA) data within a web application to either strengthen students' understanding or introduce the concept of variance and one-way analysis of variance. Using engaging data within the classroom provides context to data that…

The European Education Area aims to support Member States' efforts in enhancing the educational attainment of younger generations. In this policy context, there is a need for an objective tool to assess the educational outcomes of EU countries. The present report addresses this need by pursuing two objectives: (1) providing a comprehensive method…