To solve the attenuation paradox in computerized adaptive testing (CAT), this study proposes an item selection method, the integer programming approach based on real-time test data (IPRD), to improve test efficiency. The IPRD method turns information regarding the ability distribution of the population from real-time test data into feasible test…

In various fields, including college admission, medical board certifications, and military recruitment, high-stakes decisions are frequently made based on scores obtained from large-scale assessments. These decisions necessitate precise and reliable scores that enable valid inferences to be drawn about test-takers. However, the ability of such…

We draw upon Appadurai's 'scapes' and Latour's Actor Network Theory (ANT) to interrogate historical and spatial flows in relation to specific testing technologies. We reveal how testing systems, conceptualised as actor-networks, rearticulate colonial legacies of inequality which are intensified by new and emerging technologies. ANT helps trace…

Recent research has demonstrated an intersectional approach to the study of differential item functioning (DIF). This approach expands DIF to account for the interactions between what have traditionally been treated as separate grouping variables. In this paper, we compare traditional and intersectional DIF analyses using data from a state testing…

Monitoring applications (MAs) use digital and online tools to collect and track data on student behavior, and they have become increasingly popular among schools. Empirical research on these complex surveillance platforms is scant, and little is known about the efficacy or impact that they have on students. This study used a multi-method…

This paper aims to address Digital Readiness in Higher Education Institutions from the perspective of data-informed and evidence-based assessment of Digital Readiness. Related research suggests that existing instruments for assessing digitalization aspects are limited to self-assessment, and there is a need for data-informed frameworks that will…

During this digital era, France, like many other countries, is undergoing a transition from paper-based assessments to digital assessments in education. There is a rising interest in technology-enhanced items which offer innovative ways to assess traditional competencies, as well as addressing problem solving skills, specifically in mathematics.…

Video clickstream behaviors such as pause, forward, and backward offer great potential for educational data mining and learning analytics since students exhibit a significant amount of these behaviors in online courses. The purpose of this study is to investigate the predictive relationship between video clickstream behaviors and students' test…

Background: Most United States schools include school-based physical fitness testing (SB-PFT), yet little evidence shows how it is implemented, perceived, and used. Purpose: 1) Explore stakeholders' experiences with SB-PFT; 2) identify: challenges in analyzing fitness data, ways schools can use fitness data, and predictors of meeting fitness…

Education officials have long hoped that the statewide academic assessments most students take each year could be used not only for accountability but also to guide instruction. Congress established the Innovative Assessment Demonstration Authority (IADA) program in 2015 to help address this goal, offering up to seven states temporary flexibility…

This appendix volume supplements "Evaluating the Federal Innovative Assessment Demonstration Authority: Early Implementation and Progress of State Efforts to Develop New Statewide Academic Assessments. Evaluation Report. NCEE 2023-004" analyzing the early progress of the first five assessment systems participating in the Innovative…

The idea of data-based decision-making (DBDM) at the classroom level is that teachers use assessment data to adapt their instruction to students' individual needs and thus improve students' learning progress. In this study, we first investigate this theoretically assumed DBDM process, and second, we evaluate the effectiveness of teacher support on…

Technology-based assessments that involve collaboration among students offer many sources of process data, although it remains unclear which aspects of these data are most meaningful for making inferences about students' collaborative skills. Recent research has focused mainly on theory-based rubrics for qualitative coding of process data (e.g.,…

In 2017, the mathematics assessments that are part of the National Assessment of Educational Progress (NAEP) program underwent a transformation shifting the administration from paper-and-pencil formats to digitally-based assessments (DBA). This shift introduced new interactive item types that bring rich process data and tremendous opportunities to…

In this article, we explore how values in education are negotiated and partly redefined by teachers, school leaders and local administrators with data use and accountability. Two dilemmas are prominent for the teachers: 1) Testing and data use are perceived as important to meet the needs of the students and to create transparency and initiating…