One of the most important indicators of artificial intelligence applications used to improve quality, effectiveness, and student success by optimizing instructional processes is readiness. Readiness is the cognitive, affective, and behavioral state of performing a behavior or using a technology. In this context, the development of a data…

The intricate relationship between representational competence and content knowledge in organic chemistry has been widely debated, and the ways in which representations contribute to task difficulty, particularly in assessment, remain unclear. This paper presents a multiple-choice test instrument for assessing individuals' knowledge of fundamental…

This study discusses the characteristics of test specifications (specs) and item writer guidelines (IWGs), their role in item development of English as a Second Language (ESL) reading tests, and the use of the CEFR for specs development. This mixed-method study analyzed specs, IWGs, tests, and the Pearson Test of English General test statistics.…

Completing questionnaires is a complex task in which multiple cognitive processes play an important role. Despite critiques of the reliability of questionnaires, our research strived to gain more insight into the process of completing questionnaires by using eye-tracking. We investigated how both the question and the categories of answers were…

This article presents generalizations of SIBTEST and crossing-SIBTEST statistics for differential item functioning (DIF) investigations involving more than two groups. After reviewing the original two-group setup for these statistics, a set of multigroup generalizations that support contrast matrices for joint tests of DIF are presented. To…

Free text answers to short questions can reflect students' mastery of concepts and their relationships relevant to learning objectives. However, automating the assessment of free text answers has been challenging due to the complexity of natural language. Existing studies often predict the scores of free text answers in a "black box"…

The present study examined the relationship between working memory capacity (WMC) and comprehension on a multiple text assessment from the ACT test for college preparedness in which texts are available during question answering. Specifically, it was of interest whether differences in relations would be seen across different question types. Only…

The idea of student engagement as a predictor of student success was first introduced by Alexander Astin (1974; 1984) who studied student involvement. The connection of student involvement and student success has led to the focus on student and how we measure it to ensure that institutions are doing all they can to improve outcomes. Nothing has…

E-assessments are becoming increasingly common and progressively more complex. Consequently, how these longer, more complex questions are designed and marked is imperative. This article uses the NUMBAS e-assessment tool to investigate the best practice for creating longer questions and their mark schemes on surveying modules taken by engineering…

The adaptive learning environment provides learning support that suits individual characteristics of students, and the student model of the adaptive learning environment is the key element to promote individualized learning. This paper provides a systematic overview of the existing student models, consequently showing that the Elo rating system…

Screening items for parameter drift helps protect against serious validity threats and ensure score comparability when equating forms. Although many high-stakes credentialing examinations operate with small sample sizes, few studies have investigated methods to detect drift in small sample equating. This study demonstrates that several newly…

In line with the journal volume's theme, this essay considers lessons from the past and visions for the future of test validity. In the first part of the essay, a description of historical trends in test validity since the early 1900s leads to the natural question of whether the discipline has progressed in its definition and description of test…

It is said that working on forgiveness in psychological counseling will significantly benefit the individual, taking into account the good consequences of forgiving on the individual. This study aimed to develop a measurement tool for determining self-efficacy to work on forgiveness in counseling (SSWOFIC). The most commonly regarded forgiveness…

This article discusses visual techniques for detecting test items that would be optimal to be selected to the final compilation on the one hand and, on the other hand, to out-select those items that would lower the quality of the compilation. Some classic visual tools are discussed, first, in a practical manner in diagnosing the logical,…

Researchers frequently use Mokken scale analysis (MSA), which is a nonparametric approach to item response theory, when they have relatively small samples of examinees. Researchers have provided some guidance regarding the minimum sample size for applications of MSA under various conditions. However, these studies have not focused on item-level…