Scientific inquiry ability is closely related to the process of hands-on inquiry practice. However, its assessment is often separated from this practice due to the limitation of technical basis and labor cost. The development of multimodal data analysis provides a new opportunity to realize automated assessment based on hands-on practice.…

This study explores the effectiveness of using ChatGPT, an Artificial Intelligence (AI) language model, as an Automated Essay Scoring (AES) tool for grading English as a Foreign Language (EFL) learners' essays. The corpus consists of 50 essays representing various types including analysis, compare and contrast, descriptive, narrative, and opinion…

Virtual performance assessments (VPAs), such as game- and simulation-based assessments, provide promising ways for assessing complex and integrated skills. However, the high cost, long development cycle, and complex scoring process significantly hinder the adoption of VPAs, particularly in large-scale assessments with tight deadlines and limited…

This study examined the potential use of keystroke dynamics to create keyprints (typing fingerprints) to authenticate individuals in online assessment situations. The implications of this study are best understood in terms of the keystroke behavioral biometric. While previous studies considered the degree to which keystroke typing patterns are…

In learning, errors are ubiquitous and inevitable. As these errors may signal otherwise latent cognitive processes, tutors--and students alike--can greatly benefit from the information they provide. In this paper, we introduce and evaluate the Systematic Error Tracing (SET) model that identifies the possible causes of systematically observed…

Medical education has gone online because of the COVID-19 pandemic. Formative assessment is essential to facilitate the learning process in medical education. However, various challenges arise during online assessment, which include reliability, when done without monitoring and practical concerns like Internet connectivity issues. This study was…

The COVID-19 pandemic created a situation for the implementation of emergency remote learning. This meant that as a lecturer at a traditionalist University of contact sessions, the pandemic forced us to teach remotely through online methods of communication, using online lectures, narrated powerpoints, voice clips, podcasts, interviews and…

Low examinee effort is a major threat to valid uses of many test scores. Fortunately, several methods have been developed to detect noneffortful item responses, most of which use response times. To accurately identify noneffortful responses, one must set response time thresholds separating those responses from effortful ones. While other studies…

Outbreak of COVID-19, online examination, and e-proctoring have caused more exam anxiety and affected exam performance among students' studying in International Baccalaureate (IB) Diploma Programme (DP). Therefore, the present research aimed to find effect of online test anxiety on academic performance of IBDP students in the subjects related to…

Although the effectiveness and experiences of computer-based examinations is a widely investigated area of research, the question of whether and how computer-based assessment limits or heightens the experience of negative test emotions remains largely unexamined. Drawing from the control-value theory of achievement emotions, we investigated…

A student's profile defines the best way a student chooses to learn. It comprises information on student's characteristics such as background knowledge, learning style preference, goals, personality etc. The foremost challenge that the students experience in learning system is that they are unable to bring back relevant information based on their…

In 2017, the mathematics assessments that are part of the National Assessment of Educational Progress (NAEP) program underwent a transformation shifting the administration from paper-and-pencil formats to digitally-based assessments (DBA). This shift introduced new interactive item types that bring rich process data and tremendous opportunities to…

The COVID-19 pandemic has led to rapid change, unprecedented in higher education. One such change has been the almost complete shift to online assessment. The simultaneous employment of online assessment and proctoring has not enjoyed the rigorous academic debate and research traditionally associated with such shifts in academia. This engagement…

School readiness is recognized as one of the key starting points for children's further success in their school work and in their subsequent career. However, many kindergarten teachers still miss and long for a comprehensive, reliable and standardized diagnostic tool which could help them recognize the level of children's school readiness. That is…

Background: Examinees may not make enough effort when responding to test items if the assessment has no consequence for them. These disengaged responses can be problematic in low-stakes, large-scale assessments because they can bias item parameter estimates. However, the amount of bias, and whether this bias is similar across administrations, is…