State education agencies are sitting on rich repositories of quantitative and qualitative assessment data. This document is designed to provide a conceptual framework and implementation guidance that can help agency leadership leverage and interrogate student performance data in systematic ways for reporting, outreach, and planning purposes. The…

The NAEP EDM Competition required participants to predict efficient test-taking behavior based on log data. This paper describes our top-down approach for engineering features by means of psychometric modeling, aiming at machine learning for the predictive classification task. For feature engineering, we employed, among others, the Log-Normal…

Drawing upon recent theorising of numbers and data, and applications to schooling, this paper reveals how tensions between more accountability-oriented logics, and more contextually-situated conceptions of engagement with data, played out in one school in a regional community in northern Queensland, Australia. The research reveals that at the same…

The National Assessment Program for Literacy and Numeracy (NAPLAN) is intended to assess all Australian students in Years 3, 5, 7 and 9 to ensure equity and inclusion. This paper explores the extent to which equity and inclusion are achieved for students with disability through NAPLAN reporting. Document analysis of publicly accessible NAPLAN…

The quality of students' writing skills continues to concern educators. Because writing is essential to success in both college and career, poor writing can have lifelong consequences. Writing is now primarily done digitally, but students receive limited explicit instruction in digital writing. This lack of instruction means that students fail to…

In 2017, the mathematics assessments that are part of the National Assessment of Educational Progress (NAEP) program underwent a transformation shifting the administration from paper-and-pencil formats to digitally-based assessments (DBA). This shift introduced new interactive item types that bring rich process data and tremendous opportunities to…

The finite population correction (FPC) factor is often used to adjust variance estimators for survey data sampled from a finite population without replacement. As a replicated resampling approach, the jackknife approach is usually implemented without the FPC factor incorporated in its variance estimates. A paradigm is proposed to compare the…

To support continuous professional development model in the teaching and learning of mathematics, many districts and schools have begun hiring elementary mathematics coaches and/or specialists (MCSs). However, limited large-scale empirical research exists that determines how the use of MCSs affect student learning and achievement. Kristin E.…

In Australia, under the National Assessment Plan, educational accountability testing in literacy and numeracy (NAPLAN) is undertaken with all students in Years 3, 5, 7 and 9 to monitor student achievement and inform policy. However, the extent to which these data have been analysed to report student progress is limited. This article reports a…

Over the past three decades Australia has developed an increasingly advanced national system of student assessments, results from which have been used to identify areas of growth, stagnation or decline in student learning. For the most part, trends in different standardised assessments have been considered in isolation. By examining literacy and…

Automatic machine learning (AutoML) methods automate the time-consuming, feature-engineering process so that researchers produce accurate student models more quickly and easily. In this paper, we compare two AutoML feature engineering methods in the context of the National Assessment of Educational Progress (NAEP) data mining competition. The…

In March 2020, the National Center for Special Education Research (NCSER) virtually convened a group of experts to discuss gaps in research on eighth grade mathematics for students with disabilities (SWD) that could be addressed with the NAEP process data and data science techniques for this research. Invited experts also provided recommendations…

Statistical terms are used in everyday language and, at times, used in non-statistical ways. It is often assumed students understand statistical terms because of their common use; however, research into their understanding of specific statistical terms is scant. This report focuses on 58 Year 3 students' responses to the basic question, "What…

This article reveals the multiple ways in which data are constituted as a vehicle for governing teachers' work and learning. Drawing on the concept of governance, including in relation to the sociology of numbers, and data from one school in Queensland, Australia, the research reveals how teachers' work and learning were constituted through…

Purpose: This paper argues that in a well-organised school with strong leadership and vision coupled with a concerted effort to improve the teaching performance of each teacher, student achievement can be enhanced. The purpose of this paper is to demonstrate that while macro-effect sizes such as "whole of school" metrics are useful for…