Partially automated assessment is implemented via the 'Printable worksheet' mode in the Numbas e-assessment system to create a mathematical modelling worksheet which is individualised with random parameters but completed and marked as if it were a non-automated piece of coursework, preserving validity while reducing the risk of academic misconduct…

ETS scientists developed a human-centered AI (HAI) framework that combines data on how students interact with assessments--such as task navigation and time spent--with their performance, providing deeper insights into student performance in large-scale assessments.

As a result of the increase in online course offerings at colleges and universities, the prevalence of online and computerized examinations has increased over the last two decades. Beyond academia, online examinations have been used to assess competence for certifications by both governments and private firms. Despite this importance, a randomized…

As an integral part of dynamic assessment, computerized dynamic assessment (CDA) offers learners computer-assisted automated mediation. Accordingly, the possible efficacy of corrective feedback seems to be enhanced with new technologies, such as artificial intelligence tools, that offer automatic corrective feedback. Using technology-enhanced…

We explored the practicality of relatively small item pools in the context of low-stakes Computer-Adaptive Testing (CAT), such as CAT procedures that might be used for quick diagnostic or screening exams. We used a basic CAT algorithm without content balancing and exposure control restrictions to reflect low stakes testing scenarios. We examined…

Mastering SQL programming skills is fundamental in computer science education, and Online Judging Systems (OJS) play a critical role in automatically assessing SQL codes, improving the accuracy and efficiency of evaluations. However, these systems are vulnerable to manipulation by students who can submit "cheating codes" that pass the…

This study investigated the optimal feedback intervals for tasks of varying difficulty levels in online testing and whether task difficulty moderates the effect of feedback intervals on student performance. A pre-experimental study with 36 students was conducted to determine the delayed time for providing feedback based on student behavioral data.…

This study aims to explore the impact of the fairness of semester-end e-assessment in terms of policy provision, monitoring, and authenticity. The cross-sectional online survey design was employed among 346 students at Nepal Open University (NOU). The results were analyzed by using t-test, analysis of variance, and structural equation modeling.…

The rise of the digital era has led to a decline in handwriting as the primary mode of communication, resulting in negative effects on handwriting literacy, particularly in complex writing systems such as Chinese. The marginalization of handwriting has contributed to the deterioration of penmanship, defined as the ability to write aesthetically…

The Penn Computerized Neurocognitive Battery (CNB) is a collection of tests validated using neuroimaging, genetics, and other criteria. An updated version of the CNB was constructed in which all tests were converted to either computerized adaptive (CAT) or abbreviated forms. In a mixed community/clinical sample (N = 307; mean age = 25.9 years;…

Item position effect (IPE) refers to situations where an item performs differently when it is administered in different positions on a test. The majority of previous research studies have focused on investigating IPE under linear testing. There is a lack of IPE research under adaptive testing. In addition, the existence of IPE might violate Item…

Multistage testing (MST), a variant of computerized adaptive testing (CAT), differs from conventional CAT in that it is adapted at the module level rather than at the individual item level. Typically, all examinees begin the MST with a linear test form in the first stage, commonly known as the routing stage. In 2020, Han introduced an innovative…

Computer Aided Detection (CAD) has been used to help readers find cancers in mammograms. Although these automated systems have been shown to help cancer detection when accurate, the presence of CAD also leads to an over-reliance effect where miss errors and false alarms increase when the CAD system fails. Previous research investigated CAD systems…

Question generation (QG) task plays a crucial role in adaptive learning. While significant QG performance advancements are reported, the existing QG studies are still far from practical usage. One point that needs strengthening is to consider the generation of question group, which remains untouched. For forming a question group, intrafactors…

As computer-based testing becomes more prevalent, the attention paid to response time (RT) in assessment practice and psychometric research correspondingly increases. This study explores the rate of Type I error in detecting preknowledge cheating behaviors, the power of the Kullback-Leibler (KL) divergence measure, and the L person fit statistic…