Increased use of computer-based assessments has facilitated data collection processes that capture both response product data (i.e., correct and incorrect) and response process data (e.g., time-stamped action sequences). Evidence suggests a strong relationship between respondents' correct/incorrect responses and their problem-solving proficiency…

The OECD's PISA program assesses 15-year-old students globally in key competencies every 3 years, providing influential data on education quality and spurring policy debates. In the latest cycle, the innovation domain focused on creative thinking, assessing over 140,000 students across 60+ countries, in the largest study of adolescent creativity…

There has been a growing research interest in the identification and management of disengaged test taking, which poses a validity threat that is particularly prevalent with low-stakes tests. This study investigated effort-moderated (E-M) scoring, in which item responses classified as rapid guesses are identified and excluded from scoring. Using…

Test-based accountability policy in the US has resulted in increased availability and use of assessment systems to support instructional decision making. Though limited, literature to date suggests an important role for these systems as tools, mediating teacher knowledge and action. We examine system log data from NWEA's MAP assessment to better…

This paper uses data from the OECD's 2015 PISA and an endogenous treatment effects model to investigate the impact of different intensities of digital device use for academic purposes on science learning outcomes. When we do not differentiate the location of device use, we find that greater use can help students improve their science scores in…

Education officials have long hoped that the statewide academic assessments most students take each year could be used not only for accountability but also to guide instruction. Congress established the Innovative Assessment Demonstration Authority (IADA) program in 2015 to help address this goal, offering up to seven states temporary flexibility…

This appendix volume supplements "Evaluating the Federal Innovative Assessment Demonstration Authority: Early Implementation and Progress of State Efforts to Develop New Statewide Academic Assessments. Evaluation Report. NCEE 2023-004" analyzing the early progress of the first five assessment systems participating in the Innovative…

Education officials have long hoped that the statewide academic assessments most students take each year could be used not only for accountability but also to guide instruction. Congress established the Innovative Assessment Demonstration Authority (IADA) program in 2015 to help address this goal, offering up to seven states flexibility from…

Accurate and efficient universal screening is a foundational component of multi-tiered systems of support for reading. By the time students reach middle school, educators often have extant data available to inform screening decisions. Therefore, the decision to collect additional data to inform screening should be considered carefully. The…

This paper sets out to explore the different uses made of Organisation for Economic Co-operation and Development Program for International Student Assessment (OECD-PISA) tests and data in mathematics education research. Through a comprehensive literature review of journals and conference papers, we show that although a large variety of topics is…

Many of the analytical models commonly used in educational research often aim to maximize explained variance and identify variable importance within models. These models are useful for understanding general ideas and trends, but give limited insight into the individuals within said models. Data envelopment analysis (DEA), is a method rooted in…

It's been nearly 25 years since the first MCAS tests were taken. Since then, the test and the state's accountability system have brought resources to underfunded schools, highlighted inequities in our education system, and pushed Massachusetts to first in the nation in academics. But, with progress stalling, a new understanding of the importance…

In large-scale assessments, performance differences across different groups are regularly found. These group differences (e.g., gender differences) are often relevant for educational policy decisions and measures. However, the formation of these group differences usually remains unclear. We propose an approach for investigating this formation by…

Large-scale learning assessments can be used to generate performance and contextual data on student learning outcomes. The UNESCO International Institute for Educational Planning (IIEP-UNESCO) has conducted a qualitative study to explore both how and why learning assessment data are used in six sub-Saharan African countries. This Information Sheet…

When Dr. Tonya Williams set out to improve the assessment program for the Georgia Leadership Preparatory Academy, she knew she had to develop a strategy that respected her teachers' time. "Students need and want to grow," she explains, "and that happens through improved teacher pedagogy. But to make that a reality, you have to give…