Cost, cost-effectiveness, and benefit-cost analysis are methods used by economists to evaluate public policies. Essentially, these methods rely on impact evaluations, that is, research studies of efficacy and effectiveness. However, in most research in education, these cost and impact evaluations are performed separately. This separation creates…

The natural experiment proposed in this article extracts three stories from boxes of "100 paper clips". The activity requires students to apply three lessons from inferential statistics, starting with a hypothesis test and including confidence intervals as well as tolerance intervals.

Cronbach's alpha is the most frequently used measure to investigate the reliability of measurement instruments. Despite its frequent use, many warn for misinterpretations of alpha. These claims about regular misunderstandings, however, are not based on empirical data. To understand how common such beliefs are, we conducted a survey study to test…

Cohen's kappa coefficient is commonly used for assessing agreement between classifications of two raters on a nominal scale. Three variants of Cohen's kappa that can handle missing data are presented. Data are considered missing if one or both ratings of a unit are missing. We study how well the variants estimate the kappa value for complete data…

Benefiting from item preknowledge (e.g., McLeod, Lewis, & Thissen, 2003) is a major type of fraudulent behavior during educational assessments. This paper suggests a new statistic that can be used for detecting the examinees who may have benefitted from item preknowledge using their response times. The statistic quantifies the difference in…

Mixed methods research is still an evolving area. However, it has various characteristics like "paradigm pluralism", "focus on research questions than the research design" etc. Mixed methods research is not just one phase of a research but it enters into all stages of research process right from the stage of writing the…

This paper presents a novel design for an upper-level undergraduate statistics course structured around data rather than methods. The course is designed around curated datasets to reflect real-world data science practice and engages students in experiential and peer learning using the data science competition platform Kaggle. Peer learning is…

Research funders and policymakers increasingly focus on societal benefits of their investments in research. Research institutions thus face increasing pressure to demonstrate their societal impact to prove their legitimacy and worth. To this end, research institutions need reliable, quantitative methods to measure societal impact. This article…

Our purpose is to proffer QuantCrit methodological approaches to interrogate notions of statistical practice by convention. We present two approaches to meta-analysis and mean effect size calculations for student achievement. The first approach is the conventional approach which applies between-group differences to calculate effect sizes…

Network meta-analysis is a popular method to synthesize the information obtained in a systematic review of studies (e.g., randomized clinical trials) involving subsets of multiple treatments of interest. The dominant method of analysis employs within-study information on treatment contrasts and integrates this over a network of studies. One…

This paper presents an application of the Kalman filter in signal processing in instrumentation systems when the conditions of the environment generate a large amount of interference for the acquisition of signals from measurement systems. The unwanted interferences make important use of the instrumentation system resources and do not represent…

The COVID-19 Pandemic has presented the educational system with challenges that have caused adaptive instruction techniques for all student populations in one way or another. The researcher chose to focus specifically on the impact of adaptive instruction as a result of the COVID-19 Pandemic in the area of mathematics by evaluating student growth…

With the shift to remote teaching, many instructors used Zoom for synchronous work. However, this presented issues (fatigue, turning cameras off, inequitable technical hurdles) that motivated quantitative reasoning (QR) instructors to look for asynchronous alternatives. A common technique has been textbased online discussions, which can be…

This simulation study examines the characteristics of the Explanatory Item Response Model (EIRM) when estimating treatment effects when compared to classical test theory (CTT) sum and mean scores and item response theory (IRT)-based theta scores. Results show that the EIRM and IRT theta scores provide generally equivalent bias and false positive…

Reliable measurements are key to social science research. Multiple measures of reliability of the total score have been developed, including coefficient alpha, coefficient omega, the greatest lower bound reliability, and others. Among these, the coefficient alpha has been most widely used, and it is reported in nearly every study involving the…