A major challenge in the widespread application of Mokken scale analysis (MSA) to educational performance assessments is the requirement of complete data, where every rater rates every student. In this study, simulated and real data are used to demonstrate a method by which researchers and practitioners can apply MSA to incomplete rating designs.…

The purpose of this study is to address the necessity of subscore equating and to evaluate the performance of various equating methods for subtests. Assuming the random groups design and number-correct scoring, this paper analyzed real data and simulated data with four study factors including test dimensionality, subtest length, form difference in…

One crucial function of a classroom, and a school more generally, is to prepare students for future learning. Students should have the capacity to learn new information and to acquire new skills. This ability to "learn" is a core competency in our rapidly changing world. But how do we measure ability to learn? And how can we measure how…

Multidimensional Item Response Theory (MIRT) is widely used in assessment and evaluation of educational and psychological tests. It models the individual response patterns by specifying functional relationship between individuals' multiple latent traits and their responses to test items. One major challenge in parameter estimation in MIRT is that…

This paper presents a novel design for an upper-level undergraduate statistics course structured around data rather than methods. The course is designed around curated datasets to reflect real-world data science practice and engages students in experiential and peer learning using the data science competition platform Kaggle. Peer learning is…

Research funders and policymakers increasingly focus on societal benefits of their investments in research. Research institutions thus face increasing pressure to demonstrate their societal impact to prove their legitimacy and worth. To this end, research institutions need reliable, quantitative methods to measure societal impact. This article…

Our purpose is to proffer QuantCrit methodological approaches to interrogate notions of statistical practice by convention. We present two approaches to meta-analysis and mean effect size calculations for student achievement. The first approach is the conventional approach which applies between-group differences to calculate effect sizes…

Network meta-analysis is a popular method to synthesize the information obtained in a systematic review of studies (e.g., randomized clinical trials) involving subsets of multiple treatments of interest. The dominant method of analysis employs within-study information on treatment contrasts and integrates this over a network of studies. One…

This paper presents an application of the Kalman filter in signal processing in instrumentation systems when the conditions of the environment generate a large amount of interference for the acquisition of signals from measurement systems. The unwanted interferences make important use of the instrumentation system resources and do not represent…

The COVID-19 Pandemic has presented the educational system with challenges that have caused adaptive instruction techniques for all student populations in one way or another. The researcher chose to focus specifically on the impact of adaptive instruction as a result of the COVID-19 Pandemic in the area of mathematics by evaluating student growth…

With the shift to remote teaching, many instructors used Zoom for synchronous work. However, this presented issues (fatigue, turning cameras off, inequitable technical hurdles) that motivated quantitative reasoning (QR) instructors to look for asynchronous alternatives. A common technique has been textbased online discussions, which can be…

This simulation study examines the characteristics of the Explanatory Item Response Model (EIRM) when estimating treatment effects when compared to classical test theory (CTT) sum and mean scores and item response theory (IRT)-based theta scores. Results show that the EIRM and IRT theta scores provide generally equivalent bias and false positive…

As future chemical engineers, it is important that students be able to identify and quantify sources of error. A statistical analysis technique that is often overlooked is hierarchical design methodology, which allows for the separation of overall variance into several related components. While hierarchical methodology is relevant to many fields,…

In this study, whether item position effects lead to DIF in the condition where different test booklets are used was investigated. To do this the methods of Lord's chi-square and Raju's unsigned area with the 3PL model under with and without item purification were used. When the performance of the methods was compared, it was revealed that…

With the rapid growth of leadership research and the increasing complexity of research methods, preparing doctoral students to do research in leadership studies is becoming more challenging. This article outlines an exploratory research study and presents results of what is currently being done by university PhD leadership programs to prepare…