The use of computerized adaptive testing algorithms for ranking items (e.g., college preferences, career choices) involves two major challenges: unacceptably high computation times (selecting from a large item pool with many dimensions) and biased results (enhanced preferences or intensified examinee responses because of repeated statements across…

Ten years ago, the author worked as the Director of Assessments for the District of Columbia Public Schools (DCPS). For temporal context, the author arrived after the first of the infamous test cheating scandals and left just before the incident that spawned a second. Indeed, the author filled a new position created to both manage test security…

This research applied a web-based dynamic assessment system, GPAM-WATA system, to help low English achievers to perform self-directed learning of junior high school English grammar. A quasi-experimental design was adopted. A total of 124 seventh graders from four classes participated in this research. Participants were randomly divided into the…

Example-generation tasks have been suggested as an effective way to both promote students' learning of mathematics and assess students' understanding of concepts. E-assessment offers the potential to use example-generation tasks with large groups of students, but there has been little research on this approach so far. Across two studies, we…

A teacher competency instrument was developed to determine the level of teacher competency in small schools in Peninsular Malaysia. This study was conducted in Perak and Negeri Sembilan to determine the instrument's reliability and validity. Exploratory factor analysis (EFA) and item reliability analysis were used to determine the questionnaire's…

Time is often an accommodation used to ensure equity during assessments. The assumption is that the provision of additional time would help learners who require accommodations. In this study we examined 29 learners of differing spatial ability on visual learning tasks using static and dynamic digital images. The performance and time required to…

This research set out to enhance our understanding of the exam techniques and types of written annotations or markings that learners may wish to use to support their thinking when taking digital multiple-choice exams. Additionally, we aimed to further explore issues around the factors that contribute to learners writing less rough work and…

The Ohio Department of Education and Workforce, in response to Senate Bill 168 (135th General Assembly), initiated a pilot program in the 2024-2025 school year to test the feasibility of remotely administered and proctored state assessments. This pilot aimed to explore the potential of remote testing to enhance flexibility and accessibility for…

Online proctoring systems are employed to monitor students during exams, safeguarding assessment integrity when in-person observation is not feasible. The systems leverage advanced technologies, including artificial intelligence (AI) and biometrics, to authenticate students and identify potential exam rule violations. However, concerns about data…

Prompts play a crucial role in eliciting accurate outputs from large language models (LLMs). This study examines the effectiveness of an automatic prompt engineering (APE) framework for automatic scoring in educational measurement. We collected constructed-response data from 930 students across 11 items and used human scores as the true labels. A…

KAT6B and KAT6A belong to the MYST family of lysine acetyltransferases, and regulate gene expression via histone modification. Although both proteins share similar structure and epigenetic regulatory functions, it remains unclear if KAT6A/6B mutation disorders, both very rare conditions, yield the same neurocognitive presentation and thus benefit…

This study leverages data from direct assessments of learning (AoL) to build a dynamic model of student performance in competency exams related to computer technology. The analysis reveals three key predictors that strongly influence student success: performance on a practice exam, whether or not a student engaged in practice testing beforehand,…

What is this report about? This report presents the largest empirical evaluation of test equating methods ever conducted. Equating is the process of identifying scores on different test forms that can be treated as equivalent. Whilst various equating methods are available, there remains no consensus on which are most effective under which…

This study examines the relationship between testing accommodations, universal design (UD) features, and standardized test performance within a digital testing framework. Utilizing a novel dataset--the National Assessment of Educational Progress (NAEP) process data--and advanced statistical methodologies such as inverse probability weighting and…

This study's primary purpose was to determine how students with a learning disability (LD) in mathematics react in different testing environments, and whether changing the testing parameters can improve the outcomes. Quantitative data was collected through questionnaires, heart rates, and math fluency probes. These data were used to test the…