In international large-scale assessments, students may not be compelled to answer every test item: a student can decide to skip a seemingly difficult item or may drop out before the end of the test is reached. The way these missing responses are treated will affect the estimation of the item difficulty and student ability, and ultimately affect…

Four-parameter models have received increasing psychometric attention in recent years, as a reduced upper asymptote for item characteristic curves can be appealing for measurement applications such as adaptive testing and person-fit assessment. However, applications can be challenging due to the large number of parameters in the model. In this…

This study examines the impact of incorporating cloze tests during pauses in classroom instruction as retrieval practice activities, using Audience Response Systems (ARS) for delivery. While ARSs traditionally rely on multiple-choice questions, cloze tests offer a potentially efficient alternative that aligns with retrieval practice principles.…

This paper aims to examine and assess the questions included in the "Turkish Common Exam" for sixth graders held in the first semester of 2018 which is one of the common exams carried out by The Measurement and Evaluation Centers, in terms of question structure, quality and taxonomic value. To this end, the test questions were examined…

Large scale international assessments depend on invariance of measurement across countries. An important consideration when observing cross-national differential item functioning (DIF) is whether the DIF actually reflects a source of bias, or might instead be a methodological artifact reflecting item response theory (IRT) model misspecification.…

The study determines the conceptual understanding levels of primary school students on the concept of light according to the Rasch Model with a Four-tier Light Conceptual Understanding Test (LCUT). The participants were 355 (164 girls and 191 boys) primary school students studying at a public school in Izmir city center. In the study, the Rasch…

Artificial intelligence (AI) technology has been progressively utilized in educational environments in recent years, due to the advances in computing and information processing techniques. The automatic speech recognition technique (ASR) provides students with instantaneous feedback and interactive oral practice for supporting a context with…

The aim of this study was to investigate the quality of the Annual National Assessment (ANA) Grade 6 Mathematics assessment instrument, administered in the year 2012 guided by the main question: to what extent does the 2012 Grade 6 Mathematics assessment instrument provide meaningful and consistent information for making appropriate…

Despite decades of research on the close link between eye movements and human cognitive processes, the exact nature of the link between eye movements and deliberative thinking in problem-solving remains unknown. Thus, this study explored the critical eye-movement indicators of deliberative thinking and investigated whether visual behaviors could…

In this research, the effect of an item's type and cognitive level on its difficulty index was investigated. The data source of the study consisted of the responses of the 12535 students in the Turkey sample (6079 and 6456 students from eighth and fourth grade respectively) of TIMSS 2015. The responses were a total of 215 items at the eighth-grade…

According to the RAND model framework, reading comprehension test performance is influenced by readers' reading skills or reader characteristics, test properties, and their interactions. However, little empirical research has systematically compared the impacts of reader characteristics, test properties, and reader-test interactions across…

This classroom experiment investigates the effects of adding representational pictures to multiple-choice and constructed-response test items to understand the role of the response format for the multimedia effect in testing. Participants were 575 fifth- and sixth-graders who answered 28 science test items--seven items in each of four experimental…

A challenge in digital learning games is assessing students' learning behaviors, which are often intertwined with game behaviors. How do we know whether students have learned enough or needed more practice at the end of their game play? To answer this question, we performed post hoc analyses on a prior study of the game "Decimal Point,"…

This study works to answer the question: In what ways are pre-service social studies teachers conceptualizing the difficult knowledge of climate crisis? By analyzing a small group discussion following a pedagogical encounter with climate crisis in a teacher education program, and employing the notion of difficult knowledge, the author theorizes…

In this study, we analyzed the imprecise (i.e., less mathematically precise) responses that 148 third- to fifth-grade Chinese students made on selected-response problems that were part of a spontaneous mathematical focusing task, the Quantitative Relations Test for Chinese Children (QRTC[superscript 2]). The purpose for this analysis was to…