The purpose of this meta-analysis was to examine the effects of Gamified-Assessment Tools (GAT) used in formal educational settings on student academic achievement. We used PRISMA systematic procedures to screen the articles across Web of Science, ERIC, Scopus, Pubmed, and PsycArticles databases. We identified 23 independent results from 17…

Dynamic assessment is heavily based on Vygotskian socio-cultural theory and in recent years researchers have shown interest in the theory as a way to facilitate learning. This study attempted to examine the comparative effect of group dynamic assessment (GDA) and computerized dynamic assessment (CDA) on listening development, L2 learners'…

Background: In testing contexts that are predominately concerned with power, rapid guessing (RG) has the potential to undermine the validity of inferences made from educational assessments, as such responses are unreflective of the knowledge, skills, and abilities assessed. Given this concern, practitioners/researchers have utilized a multitude of…

Students need more independent roles to evaluate their learning performance, especially in the absence of teachers' feedback due to some constraints such as technology and poor experience. This study investigates the potential of online self-evaluation on students' writing skills in English as a foreign language (EFL). It examines the preparatory…

With the immense interest in ChatGPT worldwide, education has seen a mix of both excitement and skepticism. To properly evaluate its impact on education, it is crucial to understand how far it can help students without prior knowledge answer assessment questions. This study aims to address this question as well as the impact of the question type.…

Studies on automatic scoring systems in writing assessments have also evaluated the relationship between human and machine scores for the reliability of automated essay scoring systems. This study investigated the magnitudes of indices for inter-rater agreement and discrepancy, especially regarding human and machine scoring, in writing assessment.…

Feedback is one of the most important factors for successful learning. Contemporary computer-based learning and testing environments allow the implementation of automated feedback in a simple and efficient manner. Previous meta-analyses suggest that different types of feedback are not equally effective. This heterogeneity might depend on learner…

Purpose: With improvements in computer technologies and test implementations in the computer environment, when advantageous points of computer-based test implementations are considered, it is inevitable to compare psychometric characteristics of paper-and-pencil tests and computer-based tests and students' success. In computer-based tests,…

Curriculum-based measurement (CBM) tools are increasingly administered through technology-based modalities such as computers and tablets. Two studies were conducted to examine whether students perform similarly on paper-based and tablet-based math fact probes. Ten students completed 1-min addition or multiplication math probes using a single-case…

IF-AT (also called answer until correct) is a revised form of traditional multiple-choice testing. It was created to provide instant feedback during testing and to tap into partial knowledge of learners. The purposes of this meta-analytic study were to compare the effectiveness of IF-AT with the traditional multiple-choice test; to assess…

We describe the development of a new, freely available, online, programmatic-level assessment tool, Measuring Achievement and Progress in Science in Physiology, or Phys-MAPS (http://cperl.lassp.cornell.edu/bio-maps). Aligned with the conceptual frameworks of Core Principles of Physiology, and Vision and Change Core Concepts, Phys-MAPS can be used…

The present study hypothesized that requiring use of an integrated learning system (ILS) would yield a learning benefit in a classroom situation. Two sections of an introductory psychology course taught by the same instructor and using the same text and exams differed with respect to whether online quizzing and concept mastery exercises in an ILS…

Despite extensive theoretical and empirical research, we do not have estimations of the magnitude of sensitivity to grammatical information during L2 online processing. This is largely due to reliance on null hypothesis significance testing (Plonsky, 2015). The current meta-analysis draws on data from one elicitation technique, self-paced reading,…

Video podcasting technology or vodcasting is a burgeoning technological advancement which can make computer assisted language learning more convenient. Video technology is extensively used in traditional L2 classrooms. Yet, video podcasting together with the application of meaningful, logical, reasonable, and challenging tasks is rarely used in…

A popular method to assess measurement invariance of a particular item is based on likelihood ratio tests with all other items as anchor items. The results of this method are often only reported in terms of statistical significance, and researchers proposed different methods to empirically select anchor items. It is unclear, however, how many…