Physics education researchers are interested in using the tools of machine learning and natural language processing to make quantitative claims from natural language and text data, such as open-ended responses to survey questions. The aspiration is that this form of machine coding may be more efficient and consistent than human coding, allowing…

Although agent-based models (ABMs) have been increasingly accepted in social sciences as a valid tool to formalize theory, propose mechanisms able to recreate regularities, and guide empirical research, we are not aware of any research using ABMs to assess the robustness of our statistical methods. We argue that ABMs can be extremely helpful to…

Clustering methods are often used in physics education research (PER) to identify subgroups of individuals within a population who share similar response patterns or characteristics. Among these, k-means (or k-modes, for categorical data) is one of the most commonly used clustering methods in PER. This algorithm, however, is distance-based rather…

Statistical knowledge is required for students in a range of disciplines. However, there are limited educator resources that exist for applying statistics to solve real-world problems. This investigation provides one approach to teaching statistics using entrepreneurial-minded learning (as a way to connect real-world applications and value…

The paradigm on which a methodological approach is developed determines the situations in which its application will be most appropriate. The quantitative approach implies a positivist paradigm, the basis of which is cause-and-effect relationships, as well as the questioning and verifying of existing theories. Positivism aims to prove that…

Meta-analytic models for dependent effect sizes have grown increasingly sophisticated over the last few decades, which has created challenges for a priori power calculations. We introduce power approximations for tests of average effect sizes based upon several common approaches for handling dependent effect sizes. In a Monte Carlo simulation, we…

Traditional statistical model evaluation typically relies on goodness-of-fit testing and quantifying model complexity by counting parameters. Both of these practices may result in overfitting and have thereby contributed to the generalizability crisis. The information-theoretic principle of minimum description length addresses both of these…

Purpose: Higher education curriculum development in the construction industry has historically received scant academic attention and often, courses/programmes are largely developed using the tacit knowledge of individual tutors. This research investigates the core interpersonal and technical skills and competencies required of a contemporary…

Multidimensionality and hierarchical data structure are common in assessment data. These design features, if not accounted for, can threaten the validity of the results and inferences generated from factor analysis, a method frequently employed to assess test dimensionality. In this article, we describe and demonstrate the application of the…

Text is a burgeoning data source for psychological researchers, but little methodological research has focused on adapting popular modeling approaches for text to the context of psychological research. One popular measurement model for text, topic modeling, uses a latent mixture model to represent topics underlying a body of documents. Recently,…

Practitioners of adult education have a long history of teaching for social change. They may, however, be uncomfortable using quantitative methods to assess the impact of their learning activities, or they might lack access to statistical analysis software. Quantitative methods help the practitioner determine whether behavioral or attitudinal…

Factor Score Regression (FSR) is increasingly employed as an alternative to structural equation modeling (SEM) in small samples. Despite its popularity in psychology, the performance of FSR in multigroup models with small samples remains relatively unknown. The goal of this study was to examine the performance of FSR, namely Croon's correction and…

Measurement of latent constructs is one of the most challenging tasks in psychological research. Unlike physical variables, latent constructs are not directly observable but are inferred through individuals' responses to a set of items often referred to as measurement instruments, tests, surveys, or assessments. For decades, exploratory factor…

Completion of remedial mathematics has been identified as one of the keys to college success. However, completion rates in remedial mathematics have been low and are of much debate across America. This study leverages machine learning techniques in trying to predict and understand completion rates in remedial mathematics. The purpose of this study…

In cognitive diagnostic assessment, multiple fine-grained attributes are measured simultaneously. Attribute hierarchies are considered important structural features of cognitive diagnostic models (CDMs) that provide useful information about the nature of attributes. Templin and Bradshaw first introduced a hierarchical diagnostic classification…