This study proposes a Bayesian method for diagnostic classification models (DCMs) for a partially known Q-matrix setting between exploratory and confirmatory DCMs. This Q-matrix setting is practical and useful because test experts have pre-knowledge of the Q-matrix but cannot readily specify it completely. The proposed method employs priors for…

One result of recent changes in testing is that previously established linking frameworks may not adequately address challenges in current linking situations. Test linking through equating, concordance, vertical scaling or battery scaling may not represent linkings for the scores of tests developed to measure constructs differently for different…

This article presents the performance of item response theory (IRT) models when double ratings are used as item scores over single ratings when rater effects are present. Study 1 examined the influence of the number of ratings on the accuracy of proficiency estimation in the generalized partial credit model (GPCM). Study 2 compared the accuracy of…

Topic models are mathematical and statistical models used to analyze textual data. The objective of topic models is to gain information about the latent semantic space of a set of related textual data. The semantic space of a set of textual data contains the relationship between documents and words and how they are used. Topic models are becoming…

As the development and application of large language models (LLMs) in physics education progress, the well-known AI-based chatbot ChatGPT4 has presented numerous opportunities for educational assessment. Investigating the potential of AI tools in practical educational assessment carries profound significance. This study explored the comparative…

This study examines the efficacy of artificial intelligence (AI) in creating parallel test items compared to human-made ones. Two test forms were developed: one consisting of 20 existing human-made items and another with 20 new items generated with ChatGPT assistance. Expert reviews confirmed the content parallelism of the two test forms.…

This article critically reviews how diagnostic models have been conceptualized and how they compare to other approaches used in educational measurement. In particular, certain assumptions that have been taken for granted and used as defining characteristics of diagnostic models are reviewed and it is questioned whether these assumptions are the…

This research explores students' homework engagement across three dimensions: (a) cognitive, (b) emotional, and (c) behavioral activities, specifically contrasting private and public secondary schools in Addis Ababa. A qualitative research methodology was utilized, with reliability and validity assessments carried out through peer review, site…

The authors are investigating potential applications of adaptive comparative judgment (ACJ) across numerous environments and learning scenarios within the Purdue Polytechnic Institute as part of Purdue's efforts to transform the undergraduate learning experience. Six courses or program areas were selected for the study, involving a wide variation…

This study reviews the traditional culminating graduate student experiences, theses, and comprehensive exams, as well as a newer, more professionally relevant option, applied research projects. We conceptualize applied projects as student-led, client-connected, hands-on, experiential projects that address a real-world communication problem or…

This paper comprehensively evaluates the online learning experience of secondary and senior secondary school students during COVID-19 in India. Nine hypotheses have been developed to explore the implications of students' online experiences and identify students' learning experiences using online platforms in contrast to their experience in…

Molenaar extended Mokken's original probabilistic-nonparametric scaling models for use with polytomous data. These polytomous extensions of Mokken's original scaling procedure have facilitated the use of Mokken scale analysis as an approach to exploring fundamental measurement properties across a variety of domains in which polytomous ratings are…

Increasing use of item pools in large-scale educational assessments calls for an appropriate scaling procedure to achieve a common metric among field-tested items. The present study examines scaling procedures for developing a new item pool under a spiraled block linking design. The three scaling procedures are considered: (a) concurrent…

Distractor analyses are routinely conducted in educational assessments with multiple-choice items. In this research report, we focus on three item response models for distractors: (a) the traditional nominal response (NR) model, (b) a combination of a two-parameter logistic model for item scores and a NR model for selections of incorrect…

This study examines the enduring problem of inconsistent K-12 grading practices by exploring the relationship between teachers' perceptions of various grading practices, such as factoring student behavior in academic grades, as related to grade level, district locale, and training. Survey responses from 2,996 K-12 teachers from one suburban and…