Response styles pose great threats to psychological measurements. This research compares IRTree models and anchoring vignettes in addressing response styles and estimating the target traits. It also explores the potential of combining them at the item level and total-score level (ratios of extreme and middle responses to vignettes). Four models…

Background and Context: Feedback on one's progress is essential to new programming language learners, particularly in out-of-classroom settings. Though many study materials offer assessment mechanisms, most do not examine the accuracy of the feedback they deliver, nor give evidence on its validity. Objective: We investigate the potential use of a…

Research suggests that generative AI (GAI) responds to divergent thinking (DT) prompts with multiple ideas, some of which seem to be original. The present investigation administered 55 DT tasks to three GAI services (Bard, GPT 3.5, and GPT 4.0). Instead of examining individual responses, an Idea Density algorithm was used to assess the output.…

Background: Compared to their typically developing peers, children and adolescents with intellectual disabilities are at an increased risk of developing emotion regulation difficulties, this is especially the case for autistic individuals with intellectual disabilities. To better understand the emotion regulation experiences of children and…

The traditional Elo rating system (ERS), widely used as a student model in adaptive learning systems, assumes unidimensionality (i.e., all items measure a single ability or skill), limiting its ability to handle multidimensional data common in educational contexts. In response, several multidimensional extensions of the Elo rating system have been…

Many large-scale assessments model proficiency with a latent regression on contextual variables. Item-response data are used to estimate the parameters of the latent variable model and are used in conjunction with the contextual data to generate plausible values of individuals' proficiency attributes. These models typically incorporate numerous…

Student agency is a key feature in feedback practices. Student feedback agency is generally defined as students' active engagement in the feedback process. Its conceptualisation has evolved from individualistic views, through unidirectional structure-agency perspectives, to more socially oriented approaches. However, this commentary argues that…

Item response theory (IRT) encompasses a broader class of measurement models than is commonly appreciated by practitioners in educational measurement. For measures of vocabulary and its development, we show how psychological theory might in certain instances support unipolar IRT modeling as a superior alternative to the more traditional bipolar…

"How do witnesses make identification decisions when viewing a lineup?" Understanding the witness decision-making process is essential for researchers to develop methods that can reduce mistaken identifications and improve lineup practices. Yet, the inclusion of fillers has posed a pivotal challenge to this task because the traditional…

The Interactive, Constructive, Active, Passive (ICAP) Framework (Chi & Wylie, 2014) is used to review and develop active learning in higher education. It is a hierarchical model based on overt behaviours seen by the teacher in the classroom. This principle is acknowledged as a limitation, especially in the case of online modes of study. In…

Knowledge tracing (KT) models predict how students will perform on future interactions, given a sequence of prior responses. Modern approaches to KT leverage "deep learning" techniques to produce more accurate predictions, potentially making personalized learning paths more efficacious for learners. Many papers on the topic of KT focus…

Popular item response theory (IRT) models are considered complex, mainly due to the inclusion of a random factor variable (latent variable). The random factor variable represents the incidental parameter problem since the number of parameters increases when including data of new persons. Therefore, IRT models require a specific estimation method…

Rating scales are ubiquitous in the social sciences, yet may present practical difficulties when response formats change over time or vary across surveys. To allow researchers to pool rating data across alternative question formats, the article provides a generalization of the ordered logit model that accommodates multiple scale formats in the…

This study conducted a comprehensive comparison of Item Response Theory (IRT) linking methods applied to a bifactor model, examining their performance on both multiple choice (MC) and mixed format tests within the common item nonequivalent group design framework. Four distinct multidimensional IRT linking approaches were explored, consisting of…

Background/purpose: This study aimed to reveal the accuracy of estimation of multiple-choice test items parameters following the models of the item-response theory in measurement. Materials/methods: The researchers depended on the measurement accuracy indicators, which express the absolute difference between the estimated and actual values of the…