Introduction: Despite the necessity for adults with lower literacy skills to undergo and succeed in high-stakes computer-administered assessments (e.g., GED, HiSET), there remains a gap in understanding their engagement with digital literacy assessments. Methods: This study analyzed process data, specifically time allocation data, from the Program…

Implementing a randomized controlled trial design, the present study investigated the effects of two types of accommodations, linguistic modification and a glossary, for English learners (ELs) taking a computer-based mathematics assessment. Process data including response time and clicks on glossary words were also examined to better interpret…

This study aimed to compare item characteristics and response time between stimulus conditions in computer-delivered listening tests. Listening materials had three variants: regular videos, frame-by-frame videos, and only audios without visuals. Participants were 228 Japanese high school students who were requested to complete one of nine…

The Indiana Department of Education's (IDOE's) Accessibility and Accommodations Information for Statewide Assessments is intended for school-level personnel and decision-making teams as they prepare for and implement Indiana statewide assessments. Information is provided for school personnel as a reference to inform guidance on universal features,…

Over the past several years, content experts, psychometricians, and researchers have been hard at work developing, refining, and studying the digital SAT. The work is grounded in foundational best practices and advances in measurement and assessment design, with fairness for students informing all of the work done. This paper shares learnings from…

The aim of this research is to reveal the opinions of teachers about the development of assessment activities in updated educational conditions. The study was conducted with the phenomenology pattern, one of the qualitative research designs. The study data were collected with semi-structured interview forms applied to primary, secondary and high…

Despite the increasing importance of language testing, technology design matters related to testing have hardly been addressed in academic research, yet not enough has been written on test-taking anxiety related to computerized speaking tests. Although students nowadays are digital natives, in our experience they seem to experience a significant…

The role of time on task (TOT) for students' attainment in a low-stakes assessment of cross-curricular skills was examined using the log data collected in the computer-based assessment (CBA). Two structural equation models were compared: Model 1, in which students' test scores were explained by grade point average (GPA) together with mastery and…

The aim of this study was to explore automaticity of lexical access and executive functions of language learners and bilinguals while considering their language automaticity. Three groups of youths aged 14 to 18 were tested: Croatian-German early bilinguals, Croatian high school students who participated in a German immersion programme at school…

Test accommodations for English learners (ELs) are intended to reduce the language barrier and level the playing field, allowing ELs to better demonstrate their true proficiencies. Computer-based accommodations for ELs show promising results for leveling that field while also providing us with additional data to more closely investigate the…

English learners (ELs) represent one of the fastest growing student populations in the United States. Given that language can serve as a barrier in EL performance, test accommodations are provided to help level the playing field and allow ELs to better demonstrate their true performance level. Test accommodations on the computer offer the ability…

Multimedia instructional materials require learners to select, organize, and integrate information across multiple modalities. To facilitate these comprehension processes, a variety of multimedia design principles have been proposed. This study further explores the redundancy principle by manipulating the degree of partial redundancy between…

This survey study examines an assessment methodology through e-quizzes administered at a military vocational college and subsequent student perceptions in spring 2013 at the "Computer Networks" course. A total of 30 Computer Technologies and 261 Electronic and Communication Technologies students took three e-quizzes. Data were gathered…

This study examined the amount of time that different ability-level examinees spend on questions they answer correctly or incorrectly across different pretest item blocks presented on a fixed-length, time-restricted computerized adaptive testing (CAT). Results indicate that different ability-level examinees require different amounts of time to…

This report presents results of the 2011 National Assessment of Educational Progress (NAEP) in writing at grades 8 and 12. In this new national writing assessment sample, 24,100 eighth-graders and 28,100 twelfth-graders engaged with writing tasks and composed their responses on computer. The assessment tasks reflected writing situations common to…