Virtual performance assessments (VPAs), such as game- and simulation-based assessments, provide promising ways for assessing complex and integrated skills. However, the high cost, long development cycle, and complex scoring process significantly hinder the adoption of VPAs, particularly in large-scale assessments with tight deadlines and limited…

In learning, errors are ubiquitous and inevitable. As these errors may signal otherwise latent cognitive processes, tutors--and students alike--can greatly benefit from the information they provide. In this paper, we introduce and evaluate the Systematic Error Tracing (SET) model that identifies the possible causes of systematically observed…

Medical education has gone online because of the COVID-19 pandemic. Formative assessment is essential to facilitate the learning process in medical education. However, various challenges arise during online assessment, which include reliability, when done without monitoring and practical concerns like Internet connectivity issues. This study was…

Low examinee effort is a major threat to valid uses of many test scores. Fortunately, several methods have been developed to detect noneffortful item responses, most of which use response times. To accurately identify noneffortful responses, one must set response time thresholds separating those responses from effortful ones. While other studies…

Outbreak of COVID-19, online examination, and e-proctoring have caused more exam anxiety and affected exam performance among students' studying in International Baccalaureate (IB) Diploma Programme (DP). Therefore, the present research aimed to find effect of online test anxiety on academic performance of IBDP students in the subjects related to…

Although the effectiveness and experiences of computer-based examinations is a widely investigated area of research, the question of whether and how computer-based assessment limits or heightens the experience of negative test emotions remains largely unexamined. Drawing from the control-value theory of achievement emotions, we investigated…

In 2017, the mathematics assessments that are part of the National Assessment of Educational Progress (NAEP) program underwent a transformation shifting the administration from paper-and-pencil formats to digitally-based assessments (DBA). This shift introduced new interactive item types that bring rich process data and tremendous opportunities to…

Purpose: The purpose of this study is to compare the overall usability and user experience of desktop computers and mobile-devices when used in a summative assessment in the context of a higher education course. Design/methodology/approach: The study follows a between-groups design. The participants were 110 first-year undergraduate students from…

The use of e-assessment methods raises important concerns regarding the reliability and validity of these methods. Potential threats to validity include mode effects and the possible influence of computer-related attitudes. Although numerous studies have now investigated the validity of online assessments in noncourse-based contexts, few studies…

Technology use is increasing in higher education, particularly for test administration. In this study, Capaldi's (1994) sequential theory, which postulates that the specific order of reinforcements and nonreinforcements influences persistence in the face of difficulty or failure, was applied to online multiple choice testing situations in regard…

COVID-19 has upset the traditional ways of teaching and looks set to continue to have an impact in the coming years. The situation in Taiwan--partial disruption and then an early return to classes--allows for a comparison of student performance in a conventional teaching and testing environment with the non-contact teaching/testing environment…

Considerable research effort has been devoted to investigating semantic priming effects, particularly, the locus of those effects. Semantically related primes might activate their target's lexical representation (through automatic spreading activation at short stimulus onset asynchronies (SOAs), or through generation of words expected to follow…

This study focused on student-content interactions and engagement in an online graduate course. Student descriptions of their experiences and learning processes in relation to digital course resources were examined to understand how and why resources were used. Fourteen students provided detailed explanations of their use and perceived value of…

The resources and time constraints of assessing large classes are always weighed up against the validity, reliability, and learning outcomes of the assessment tasks. With the digital revolution in the 21st Century, educators can benefit from computer technology to carry out a large-scale assessment in higher education more efficiently. In this…

The current study examined the relationship between test-taker cognition and psychometric item properties in multiple-selection multiple-choice and grid items. In a study with content-equivalent mathematics items in alternative item formats, adult participants' tendency to respond to an item was affected by the presence of a grid and variations of…