Scoring essays is generally an exhausting and time-consuming task for teachers. Automated Essay Scoring (AES) facilitates the scoring process to be faster and more consistent. The most logical way to assess the performance of an automated scorer is by measuring the score agreement with the human raters. However, we provide empirical evidence that…

Many test items use both an image and text, but present them in a spatially separate manner. This format could potentially cause a split-attention effect in which the test taker's cognitive load is increased by having to split attention between the image and text, while mentally integrating the two sources of information. We investigated the…

Adaptive measurement of change (AMC) is a psychometric method for measuring intra-individual change on one or more latent traits across testing occasions. Three hypothesis tests--a Z test, likelihood ratio test, and score ratio index--have demonstrated desirable statistical properties in this context, including low false positive rates and high…

Background: Mobile-based assessment has been an active area of research in the field of mobile learning. Prior research has demonstrated that mobile-based assessment systems positively affect student performance. However, it is still unclear why and how these systems positively affect student performance. Objectives: This study aims to identify…

The German school system employs centrally organized performance assessments (some of which are called "VERA") as a way of promoting lesson development. In recent years, several German federal states introduced a computer-based performance testing system which will replace the paper-pencil testing system in the future. Scores from…

The identification of effects of vocational education and training conditions on competence development in nursing education requires longitudinal studies. An important precondition is the availability of a test of nursing competence which is economical in use, measures a homogeneous construct throughout years of nursing education and across…

This study examines the online assessment-evaluation activities in distance education processes. The effects of different online exam application styles considering the online assessment-evaluation in distance education processes, including all programs of a higher education institution, were documented. The population for online…

The discourse around online summative assessment has become one of the major issues in open distance learning (ODL) worldwide. There is a lack of major research in online summative assessment in environmental education (EE) module for the bachelor of education (B.Ed.) students in ODL. The purpose of this study was to explore online summative…

Natural Language Processing (NLP) offers methods for understanding and quantifying the similarity between written documents. Within the testing industry these methods have been used for automatic item generation, automated scoring of text and speech, modeling item characteristics, automatic question answering, machine translation, and automated…

Purpose: This study examined the performance difference between remote and in-laboratory test modalities with a speech recognition in noise task in older and younger adults. Method: Four groups of participants (younger remote, younger in-laboratory, older remote, and older in-laboratory) were tested on a speech recognition in noise protocol with…

The modern era is the miracle of science and technology using information and communication in every walk of life. ICT has become the basic need of humanity. The current study explored the students' perceptions of online evaluation and assessment. In addition, it was intended to investigate the relationship of different indicators of students'…

A much-debated question in the L2 assessment field is if computer familiarity should be considered a potential source of construct-irrelevant variance in computer-based writing (CBW) tests. This study aims to make a partial validity argument for an online source-based writing test (OSWT) designed for English placement testing (EPT), focusing on…

The Digital High Stakes Assessment Programme in Cambridge University Press & Assessment is developing digital assessments for UK and global teachers and learners. In one development, the team are making decisions about the assessment models to use to assess computing systems knowledge and understanding. This research took place as part of the…

Due to the precautionary measures during the COVID-19 pandemic many universities offered unproctored take-home exams. We propose methods to detect potential collusion between students and apply our approach on event log data from take-home exams during the pandemic. We find groups of students with suspiciously similar exams. In addition, we…

Participation in educational activities is an important prerequisite for academic success, yet often proves to be particularly challenging in digital settings. Therefore, this study set out to increase participation in an online proctored formative statistics exam by digital nudging. We exploited targeted nudges based on the Fogg Behaviour Model,…