This study explores using transfer learning in machine learning for natural language processing (NLP) to create generic automated essay scoring (AES) models, providing instant online scoring for statewide writing assessments in K-12 education. The goal is to develop an instant online scorer that is generalizable to any prompt, addressing the…

The purpose of this study was to compare the classification accuracy of data produced by the previous year's end-of-year New York state assessment, a computer-adaptive diagnostic assessment ("i-Ready"), and the gating combination of both assessments to predict the rate of students passing the following year's end-of-year state assessment…

This study examines the impact of incorporating cloze tests during pauses in classroom instruction as retrieval practice activities, using Audience Response Systems (ARS) for delivery. While ARSs traditionally rely on multiple-choice questions, cloze tests offer a potentially efficient alternative that aligns with retrieval practice principles.…

Are oral sentences accompanied by pictures easier to understand than written sentences accompanied by the same pictures? This question--intensely discussed for more than two decades in educational, psychological, and psycholinguistic research in terms of "modality effect in multimedia learning," "split-attention effect," or…

We used multivariate generalizability theory to examine the reliability of hand-scoring and automated essay scoring (AES) and to identify how these scoring methods could be used in conjunction to optimize writing assessment. Students (n = 113) included subsamples of struggling writers and non-struggling writers in Grades 3-5 drawn from a larger…

Although educators are using various ways in evaluating students' learning, traditional paper pencil final exams are usually held at the end of the school year to conclude the course. During the school suspension due to the COVID-19 outbreak, this traditional approach is no longer applicable to some schools. In this article, alternative final…

Purpose: This study explores the roles of morphological skills (Morphological Awareness, Morphological-Syntactic-Knowledge, Morphological-Semantic-Knowledge, and Morphological-Orthographic/Phonological-Knowledge), vocabulary (knowledge of definitions, relationships between words, and polysemous meanings), and syntax in contributing to adolescent…

In this research, we use a process data analysis approach to gather additional evidence about students' argumentation skills beyond their performance scores in a computer-based assessment. This game-enhanced scenario-based assessment (named Seaball) included five activities that require students to demonstrate their argumentation skills within a…

The New York State Education Department (NYSED) has a partnership with Questar Assessment Inc. (Questar) for the online delivery of the 2023 Elementary-Level (Grade 5) and Intermediate-Level (Grade 8) Science Computer-Based Field Tests. Teachers from across the State work with NYSED in a variety of activities to ensure the validity and reliability…

This research applied a web-based dynamic assessment system, GPAM-WATA system, to help low English achievers to perform self-directed learning of junior high school English grammar. A quasi-experimental design was adopted. A total of 124 seventh graders from four classes participated in this research. Participants were randomly divided into the…

This study evaluated the forecasting accuracy of trend estimation methods applied to time-series data from computer adaptive tests (CATs). Data were collected roughly once a month over the course of a school year. We evaluated the forecasting accuracy of two regression-based growth estimation methods (ordinary least squares and Theil-Sen). The…

As more states move to universal computer-based assessments, an emergent issue concerns the effect that device type might have on student results. Although, several research studies have explored device effects, most of these studies focused on the differences between tablets and desktops/laptops. In the current study, we distinguish between…

English Language Learners (ELLs) are at an academic disadvantage with the rest of general education because they are linguistically challenged, especially in reading. Educators are recommended to use best practices to provide a good quality education to ELLs through the use of instructional tools. One instructional tool that is recommended to use…

Low examinee effort is a major threat to valid uses of many test scores. Fortunately, several methods have been developed to detect noneffortful item responses, most of which use response times. To accurately identify noneffortful responses, one must set response time thresholds separating those responses from effortful ones. While other studies…

In 2017, the mathematics assessments that are part of the National Assessment of Educational Progress (NAEP) program underwent a transformation shifting the administration from paper-and-pencil formats to digitally-based assessments (DBA). This shift introduced new interactive item types that bring rich process data and tremendous opportunities to…