Binary item response theory (IRT) models are widely used in educational testing data. These models are not perfect because they simplify the individual item responding process, ignore the differences among different response patterns, cannot handle multidimensionality that lay behind options within a single item, and cannot manage missing response…

Educational tests often have a cluster of items linked by a common stimulus ("testlet"). In such a design, the dependencies caused between items are called "testlet effects." In particular, the directional testlet effect (DTE) refers to a recursive influence whereby responses to earlier items can positively or negatively affect…

Modern medical training consists largely of lecture-based instruction and in vivo or video modeling of specific skills. Other instructional methods, such as teaching with acoustical guidance (TAGteach), have rarely been evaluated. In this study, we compared teaching with tactile guidance, or tactile TAGteach in which a vibratory stimulus is…

The Lognormal Response Time (LNRT) model measures the speed of test-takers relative to the normative time demands of items on a test. The resulting speed parameters and model residuals are often analyzed for evidence of anomalous test-taking behavior associated with fast and poorly fitting response time patterns. Extending this model, we…

While the provision of peer feedback has been widely recommended to enhance learning, many students are inexperienced in this area and would benefit from guidance. This study therefore examines the impact of instructions and examples on the quality of feedback provided by students on peer-developed learning resources produced via an online system,…

Economic efficiency demands accurate assessment of individual ability for selection purposes. This study investigates Classical Test Theory (CTT) and Item Response Theory (IRT) for estimating true ability and ranking individuals. Two Monte Carlo simulations and real data analyses were conducted. Results suggest a slight advantage for IRT, but…

In this response, we summarize the affirmations, extensions, and critiques of the framework for science communication training that we presented in Lewenstein and Baram-Tsabari (2022. How should we organize science communication trainings to achieve competencies? "International Journal of Science Education -- Part B: Communication and Public…

Accurate item parameters and standard errors (SEs) are crucial for many multidimensional item response theory (MIRT) applications. A recent study proposed the Gaussian Variational Expectation Maximization (GVEM) algorithm to improve computational efficiency and estimation accuracy (Cho et al., 2021). However, the SE estimation procedure has yet to…

Student agency is often mentioned as a key feature of feedback practices. Commonly, the concept of agency is used to refer to students' active role in the process of seeking, receiving, generating and acting upon feedback information. However, the notion of what student agency means is often taken for granted and rarely elaborated. The feedback…

This article is about making correction in Tarray, Singh, and Zaizai model and further improving it when stratified random sampling is necessary. This is done by using optional randomized response technique in stratified sampling using a combination of Mangat and Singh, Mangat, and Greenberg et al. models. The suggested model has been studied…

Human ratings are ubiquitous in creativity research. Yet, the process of rating responses to creativity tasks -- typically several hundred or thousands of responses, per rater -- is often time-consuming and expensive. Planned missing data designs, where raters only rate a subset of the total number of responses, have been recently proposed as one…

Exemplars are key examples chosen to represent designated levels of competence or quality. This study attempts to explore the use of exemplars in a Chinese-English translation teaching context. It involved the teacher-researcher using three exemplars of different quality to help 31 third-year translation majors evaluate their own translation and…

Research-based and practical reflection tools can enable systematic analysis of practice and contribute to deeper understandings of classroom processes. An empirically based, evidence-informed reflection tool was developed to support teachers to recognise feedback talk and how it is built into classroom interactions. The tool, titled the feedback…

So far, modeling approaches for not-reached items have considered one single underlying process. However, missing values at the end of a test can occur for a variety of reasons. On the one hand, examinees may not reach the end of a test due to time limits and lack of working speed. On the other hand, examinees may not attempt all items and quit…

When measuring latent constructs, for example, language ability, we use statistical models to specify appropriate relationships between the latent construct and observe responses to test items. These models rely on theoretical assumptions to ensure accurate parameter estimates for valid inferences based on the test results. This dissertation…