A key consideration when giving any computerized adaptive test (CAT) is how much adaptation is present when the test is used in practice. This study introduces a new framework to measure the amount of adaptation of Rasch-based CATs based on looking at the differences between the selected item locations (Rasch item difficulty parameters) of the…

Item response theory provides various important advantages for exams carried out or to be carried out digitally. For computerized adaptive tests to be able to make valid and reliable predictions supported by IRT, good quality item pools should be used. This study examines how adaptive test applications vary in item pools which consist of items…

In light of the COVID-19 pandemic, the transition from traditional face-to-face lectures to online learning, as well as the adoption of technology-enabled active learning in the classroom, has been accelerated. Here, we introduce the use of Telegram as a technological tool to support remote learning by helping students identify gaps in their…

Background: In testing contexts that are predominately concerned with power, rapid guessing (RG) has the potential to undermine the validity of inferences made from educational assessments, as such responses are unreflective of the knowledge, skills, and abilities assessed. Given this concern, practitioners/researchers have utilized a multitude of…

The National Center for Measurement (Qiyas) was established for the purpose of conducting standardized tests in Saudi Arabia. The center has developed multiple Qiyas tests such as the General Aptitude Test (GAT) and the Scholastic Achievement Admission Test (SAAT). Qiyas tests are used as a pre-requisite requirement for applying to universities…

Elaborative feedback (EF) containing explanations on students' responses benefits learning. Computer-based environments provide learners with EF in different ways, for example, on an immediate question-by-question basis or after answering a set of questions. Recent findings also suggest that delaying EF enhances learning. However, it is unclear to…

Adaptive tests are more efficient than fixed-length tests through the use of item response theory; adaptive tests also present students questions that are tailored to their proficiency level. Although the adaptive algorithm is straightforward, developing a multidimensional computer adaptive test (MCAT) measure is complex. Evidence-centered design…

In this paper, we present a system for automatic evaluation of the quality of a question paper. Question paper plays a major role in educational assessment. The quality of a question paper is crucial to fulfilling the purpose of the assessment. In many education sectors, question papers are prepared manually. A prior analysis of a question paper…

While many studies have addressed the benefits of technology-assisted L2 writing, limited research has delved into how generative artificial intelligence (GAI) supports students in completing their writing tasks in Mandarin Chinese. In this study, 26 university-level Mandarin Chinese foreign language students completed two writing tasks on two…

Psychosocial skills are variables related to human behavior, beliefs, and attitudes and shape social interactions, learning processes, academic achievements, and general goal-directed behavior. Psychosocial skills seem particularly important during the adolescent period when large changes in goal setting, learning attitudes, and ability…

This paper describes how plate tectonics and rock genesis, two topics that are typically addressed separately in secondary Earth science classes, can be taught together as an integrated system. We define the TecRocks Reasoning Framework, developed to support student reasoning about rock formation situated in the context of plate tectonics. We also…

Introduction: The present study investigated English-speaking 5-9 year olds' (n = 600, normative sample) comprehension of relative, adverbial and complement clauses using the Test of Complex Syntax-Electronic (TECS-E), an online interactive assessment. with strong test-retest reliability, concurrent validity and internal consistency. Method: Using…

Preservice elementary teachers (PSTs) prepare for various standardized assessments, such as the Praxis® licensure assessment. However, there is little research on test-taking behavior and test-taking strategies for this examinee population. A common belief and instruction given in some test preparation materials is that examinees should stick to…

Educational assessments often require uniform test forms, for which each test form has equivalent measurement accuracy but with a different set of items. For uniform test assembly, an important issue is the increase of the number of assembled uniform tests. Although many automatic uniform test assembly methods exist, the maximum clique algorithm…

This article introduces Xiao-Shih, the first intelligent question answering bot on Chinese-based massive open online courses (MOOCs). Question answering is critical for solving individual problems. However, instructors on MOOCs must respond to many questions, and learners must wait a long time for answers. To address this issue, Xiao-Shih…