Among econometricians, instrumental variable (IV) estimation is a commonly used technique to estimate the causal effect of a particular variable on a specified outcome. However, among applied researchers in the social sciences, IV estimation may not be well understood. Although there are several IV estimation primers from different fields, most…

Researchers are often interested in establishing equivalence of population variances. Traditional difference-based procedures are appropriate to answer questions about differences in some statistic (e.g., variances, etc.). However, if a researcher is interested in evaluating the equivalence of population variances, it is more appropriate to use a…

The Bayesian information criterion (BIC) can be useful for model selection within multilevel modeling studies. However, the formula for BIC requires a value for N, which is unclear in multilevel models, since N is observed in at least two levels. The present study uses simulated data to evaluate the rate of false positives and power when using a…

Quantitative literacy is a foundational component of success in STEM disciplines and in life. Quantitative concepts and data-rich activities in undergraduate geoscience courses can strengthen geoscience majors' understanding of geologic phenomena and prepare them for future careers and graduate school, and provide real-world context to apply…

Using the test scores of more than 2,250,000 students who participated in the American Mathematics Competitions (AMC) from 2009 to 2019, this study examined the direction and magnitude of the trends in gender disparity in participation and high achievement in self-select mathematics exams. The results of this study indicated that the male to…

Randomized evaluations of educational technology produce log data as a bi-product: highly granular data on student and teacher usage. These datasets could shed light on causal mechanisms, effect heterogeneity, or optimal use. However, there are methodological challenges: implementation is not randomized and is only defined for the treatment group,…

Greer and Mark's (2016) paper suggested and reviewed different methods for evaluating the effectiveness of intelligent tutoring systems such as Propensity score matching. The current study aimed at assessing the effectiveness of automated personalized feedback intervention implemented via the Student Advice Recommender Agent (SARA) in a first-year…

The need for geoscience students to develop a quantitative skillset is ever increasing. However, this can be difficult to implement in university-style lecture courses in a way that is both manageable for the instructor and does not involve lengthy, potentially repetitive, question sheets for the students. Here, a method for teaching dimensional…

The purpose of this paper is to briefly introduce two most common applications of multiple group item response theory (IRT) models, namely detecting differential item functioning (DIF) analysis and nonequivalent group score linking with a simultaneous calibration. We illustrate how to conduct those analyses using the "Stata" item…

This meta-study evaluates publication patterns and trends occurring in the first 9 years of "The Professional Counselor (TPC)." Both author (e.g., gender, domicile, employment setting, top individual and university contributors) and article characteristics (e.g., topic, research design, participant type, sample size, statistics) are…

The statistical computing and graphics software R, despite its many advantages, is sometimes considered too complex to be introduced to undergraduate political science majors. In this article I showed that when taught appropriately, R could be a valuable and well-received aspect of an introductory research methods course. It is important to teach…

We conducted a systematic literature review of 111 empirical studies published between 1969 and 2018. We found that research does not exponentially grow in comparison to research on higher education or leadership; empirical research emerging in the 1980s does not completely replace non-empirical inquiry. Studies from English-speaking authors…

Several programs of research have sought to assess the replicability of scientific findings in different fields, including economics and psychology. These programs attempt to replicate several findings and use the results to say something about large-scale patterns of replicability in a field. However, little work has been done to understand the…

Generalizability theory is a modern, powerful, and broad framework used to assess the reliability, or dependability, of measurements. While there exist classic works that explain the basic concepts and mathematical foundations of the method, there is currently a lack of resources addressing computational resources for those researchers wishing to…

In applications of item response theory (IRT), fixed parameter calibration (FPC) has been used to estimate the item parameters of a new test form on the existing ability scale of an item pool. The present paper presents an application of FPC to multiple examinee groups test data that are linked to the item pool via anchor items, and investigates…