Agreement statistics and measures of prediction accuracy are often used to assess the quality of two measures of a construct. Agreement statistics are appropriate for measures that are supposed to be interchangeable, whereas prediction accuracy statistics are appropriate for situations where one variable is the target and the other variables are…

Designing a multidimensional adaptive test (M-MST) based on a multidimensional item response theory (MIRT) model is critical to make full use of the advantages of both MST and MIRT in implementing multidimensional assessments. This study proposed two types of automated test assembly (ATA) algorithms and one set of routing rules that can facilitate…

The COVID-19 outbreak has an impact on the provision of education. One of them is the process of online assessment or examination. Difficulties occur during online exams; weak supervision can increase cheating behavior among students. Generally, teachers or lecturers think about how to prevent this behavior. However, what if they are allowed to…

In an article published in an open-access journal, (Pennebaker et al. "PLoS One," 8(11), e79774, 2013) reported that an innovative computer-based system that included daily online testing resulted in better student performance in other concurrent courses and a reduction in achievement gaps between lower and upper middle-class students.…

International large-scale assessments such as PISA or PIAAC have started to provide public or scientific use files for log data; that is, events, event-related attributes and timestamps of test-takers' interactions with the assessment system. Log data and the process indicators derived from it can be used for many purposes. However, the intended…

Competence development and measurement are of great interest to vocational education and training (VET). Although there are many instruments available for measuring competence in diverse settings, in many cases, the completed steps of validation are neither documented nor made transparent in a comprehensible manner. Understanding what an…

There have been giant leaps in the field of education in the past 1-2 years. Schools and colleges are transitioning online to provide more resources to their students. The COVID-19 pandemic has provided students more opportunities to learn and improve themselves at their own pace. Online proctoring services (part of assessment) are also on the…

When colleges and universities quickly moved their classes online last March, many faculty members gave students the option of pass/fail (P/F) grading. Usually P/F implies a student must reach the minimum passing grade of D to be awarded a P. This brings up the question of what passing a course with a D means. How much of the course material did…

Scoring essays is generally an exhausting and time-consuming task for teachers. Automated Essay Scoring (AES) facilitates the scoring process to be faster and more consistent. The most logical way to assess the performance of an automated scorer is by measuring the score agreement with the human raters. However, we provide empirical evidence that…

Instructor feedback strategies play a key role in the learning acquisition process, especially in online environments. In addition, educational improvement and reform cannot occur without timely and effective assessment approaches. This study, grounded on Bandura's 1967 "self-efficacy and social cognitive theory," focused on identifying…

This study analyzes the effect of the i-Ready program on Yorkship Family School kindergarteners and focuses on educating kindergarteners on computer-use, to tackle the i-Ready program. The i-Ready program makes it easier for the teachers to specialize in their instructions to each student and enhance effectiveness (Fokides & Zachristou, 2020).…

Twenty-three college students participated in two studies evaluating an application designed to measure stimulus overselectivity in pictures depicting facial affect. We analyzed whether this application worked as designed by evaluating whether it could provide a robust analysis of the types of errors users make (e.g., by matching by the top…

Many test items use both an image and text, but present them in a spatially separate manner. This format could potentially cause a split-attention effect in which the test taker's cognitive load is increased by having to split attention between the image and text, while mentally integrating the two sources of information. We investigated the…

Adaptive measurement of change (AMC) is a psychometric method for measuring intra-individual change on one or more latent traits across testing occasions. Three hypothesis tests--a Z test, likelihood ratio test, and score ratio index--have demonstrated desirable statistical properties in this context, including low false positive rates and high…

In order to better manage alternative assessment procedures, incorporating suitable technology can help teachers facilitate an easier, more productive practice in unique and innovative ways. The purpose of this article is, therefore, to provide ideas and resources for technology-facilitated alternative assessment in physical education.