Increased use of computer-based assessments has facilitated data collection processes that capture both response product data (i.e., correct and incorrect) and response process data (e.g., time-stamped action sequences). Evidence suggests a strong relationship between respondents' correct/incorrect responses and their problem-solving proficiency…

The OECD's PISA program assesses 15-year-old students globally in key competencies every 3 years, providing influential data on education quality and spurring policy debates. In the latest cycle, the innovation domain focused on creative thinking, assessing over 140,000 students across 60+ countries, in the largest study of adolescent creativity…

There has been a growing research interest in the identification and management of disengaged test taking, which poses a validity threat that is particularly prevalent with low-stakes tests. This study investigated effort-moderated (E-M) scoring, in which item responses classified as rapid guesses are identified and excluded from scoring. Using…

Test-based accountability policy in the US has resulted in increased availability and use of assessment systems to support instructional decision making. Though limited, literature to date suggests an important role for these systems as tools, mediating teacher knowledge and action. We examine system log data from NWEA's MAP assessment to better…

This paper uses data from the OECD's 2015 PISA and an endogenous treatment effects model to investigate the impact of different intensities of digital device use for academic purposes on science learning outcomes. When we do not differentiate the location of device use, we find that greater use can help students improve their science scores in…

Accurate and efficient universal screening is a foundational component of multi-tiered systems of support for reading. By the time students reach middle school, educators often have extant data available to inform screening decisions. Therefore, the decision to collect additional data to inform screening should be considered carefully. The…

This paper sets out to explore the different uses made of Organisation for Economic Co-operation and Development Program for International Student Assessment (OECD-PISA) tests and data in mathematics education research. Through a comprehensive literature review of journals and conference papers, we show that although a large variety of topics is…

Many of the analytical models commonly used in educational research often aim to maximize explained variance and identify variable importance within models. These models are useful for understanding general ideas and trends, but give limited insight into the individuals within said models. Data envelopment analysis (DEA), is a method rooted in…

In large-scale assessments, performance differences across different groups are regularly found. These group differences (e.g., gender differences) are often relevant for educational policy decisions and measures. However, the formation of these group differences usually remains unclear. We propose an approach for investigating this formation by…

Sources of longitudinal achievement data are increasing thanks partially to the expansion of available interim assessments. These tests are often used to monitor the progress of students, classrooms, and schools within and across school years. Yet, few statistical models equipped to approximate the distinctly seasonal patterns in the data exist,…

Research consistently has found teachers' use of assessment data for instructional purposes challenging and inconsistent. To support teachers' use of data, we need to develop shared knowledge about how data are and can be used to advance teaching and learning. However, the literature on the specific actions teachers take is inconsistent, creating…

Comparing group is one of the key uses of large-scale assessment results, which are used to gain insights to inform policy and practice and to examine the comparability of scores and score meaning. Such comparisons typically focus on examinees' final answers and responses to test questions, ignoring response process differences groups may engage…

Two separate data searches underlie this analysis of how references to educational research and to PISA are used in the Swedish education debate. The data consist of 380 newspaper articles from the eight largest print media outlets in Sweden and 200 protocols from parliamentary debates (2000 to 2016) that made explicit reference to 'PISA' and/or…

This study investigates the utility of existing measures of Oral Reading Fluency (ORF), reading retell, and language proficiency for predicting reading achievement among Spanish speaking English language learners in the United States. Consistent with previous findings, ORF predicts a large proportion of the variance in reading achievement.…

Assessment can be powerful when teachers are able to analyse, interpret and use information in ways that enhance their teaching and programmes, and students' learning. A qualitative approach was used to investigate how teachers of Years 4-8 students analyse, interpret and use information gained from administration of the Progressive Achievement…