Technology has become a fundamental means to encourage reliable and more effective assessments. Rapid technological developments have led to the widespread use of digital platforms and devices in all aspects of life. Educational institutions worldwide had to take advantage of this technological leap during pandemics such as COVID-19, which changed…

In mathematics education, assessment is increasingly conducted using computer- or tablet-based technologies as alternatives to the traditional paper-and-pencil format. Several studies have examined the impact of test mode (computer vs. paper) on test performance in mathematics, but these studies have produced mixed results and few studies…

While the potential of Dynamic Assessment (DA) and its variants (Computerized Dynamic Assessment (CDA) and Group Dynamic Assessment (GDA)) for EFL classrooms has been recognized, there is a lack of research on its practical implementation compared to the well-established field of Summative Assessment (SA). Thus, the objective of this qualitative…

Any body of research evolves over time. Previous understandings become more nuanced, ideas are supported or rebuked, and, eventually we arrive at a clearer view of the issue. The research on score comparability across computerized devices is no exception. CCSSO [Council of Chief State School Officers] and the Center for Assessment have published…

Counterfactuals describe imagined alternatives to reality that people know to be false. Successful counterfactual comprehension therefore requires people to keep in mind both an imagined hypothetical world and the presupposed real world. "Counterfactual transparency," that is, the degree to which a context makes it easy to determine…

Linguistic contexts provide useful information about verb meanings by narrowing the space of candidate concepts. Intuitively, the more information, the better. For example, "the tall girl is 'fezzing,'" as compared to "the girl is fezzing," provides more information about which event, out of multiple candidate events, is being…

Crowdsourcing is an important tool for collecting spatio-temporal data, which has various applications in education. The objectives of this study were to develop and test a laboratory exercise on soil erosion by water and field data crowdsourcing in an online introductory soil science course (FNR 2040: Soil Information Systems) at Clemson…

In line with the widespread proliferation of digital technology in everyday life, many countries are now beginning to use computer-based exams (CBEs) in their post-primary education systems. To ensure that these CBEs are delivered in a manner that preserves their fairness, validity, utility and credibility, several factors pertaining to their…

The central purpose of this paper is to examine validity problems arising from the multiple-choice items and technical passages in the Test of English as a Foreign Language Internet-based Test (TOEFL iBT) reading section, primarily concentrating on construct-irrelevant variance (Messick, 1989). My personal TOEFL iBT experience, along with my…

Assessments are important to academic institutions because they help in evaluating students' knowledge. The conduct of assessments nowadays has been influenced by the continuous evolution of information technology. Hence, academic institutions now use computers for assessments, often known as Computer-Based Assessments (CBAs), in tandem with…

Purpose: Individuals with hearing loss engage in auditory training to improve their speech recognition. They typically practice listening to utterances spoken by unfamiliar talkers but never to utterances spoken by their most frequent communication partner (FCP)--speech they most likely desire to recognize--under the assumption that familiarity…

Evidence of comparability is generally needed whenever there are variations in the conditions of an assessment administration, including variations introduced by the administration of an assessment on multiple digital devices (e.g., tablet, laptop, desktop). This article is meant to provide a comprehensive examination of issues relevant to the…

Examining the testing processes, as well as the scores, is needed for a complete understanding of validity and fairness of computer-based assessments. Examinees' rapid-guessing and insufficient familiarity with computers have been found to be major issues that weaken the validity arguments of scores. This study has three goals: (a) improving…

While studies have been done to rate the validity and reliability of the Oral Proficiency Interview (OPI) and Oral Proficiency Interview-Computer (OPIc) independently, a limited amount of research has analyzed the interexam reliability of these tests, and studies have yet to be conducted comparing the results of Spanish language learners who take…

The project aimed to examine the effect of raters' familiarity with accents on their judgments of non-native speech. Participants included three groups of raters who were either from Spanish Heritage, Spanish Non-Heritage, or Chinese Heritage backgrounds (n = 16 in each group) using Winke & Gass's (2013) definition of a heritage learner as…