Recent developments in the field of artificial intelligence allow for improved performance in the automated assessment of extended response items in mathematics, potentially allowing for the scoring of these items cheaply and at scale. This study details the grand prize-winning approach to developing large language models (LLMs) to automatically…

This study aimed to examine an assumption regarding whether generative artificial intelligence (GAI) tools can overcome the cognitive intensity that humans suffer when solving problems. We examine the performance of ChatGPT and GPT-4 on NAEP science assessments and compare their performance to students by cognitive demands of the items. Fifty-four…

In 2024, the National Center for Education Statistics (NCES) administered the National Assessment of Educational Progress (NAEP) mathematics assessment to representative samples of fourth- and eighth-grade students in the nation, states, the District of Columbia, Puerto Rico, Department of Defense schools, and 26 participating large urban…

This exploratory study investigated the behaviors and content of onscreen calculator usage by a nationally representative sample of eighth-grade students who responded to items from the 2017 National Assessment of Educational Progress mathematics assessment. Meaningful features were generated from the process data to infer whether students…

This investigation explores the relationship between the use of digital pencil and mathematical problem-solving accuracy among 1,530 students with learning disabilities (LD) and 25,400 general education (GE) peers from the 2017 digital National Assessment of Educational Progress mathematics assessment. The term "digital pencil" in this…

This investigation explores the relationship between the use of digital pencil and mathematical problem-solving accuracy among 1,530 students with learning disabilities (LD) and 25,400 general education (GE) peers from the 2017 digital National Assessment of Educational Progress mathematics assessment. The term "digital pencil" in this…

In this study, we explore the application of process mining techniques on assessment log data to explore problem-solving strategies in Algebra. By analyzing sequences of student activities, we demonstrate the significant potential of process mining in identifying problem-solving strategies that lead to successful and unsuccessful outcomes. Our…

The COVID-19 pandemic has affected student learning; according to the National Assessment of Educational Progress (2022), scores for students in the United States have shown a decline in mathematics. . One way educators can strengthen students' current mathematical knowledge and bridge to new content is through Number Talks. Number Talks are brief…

Grades 4 and 8 students had shown slow but steady improvement in scores on the National Assessment of Educational Progress (NAEP) mathematics assessment from 1990 until 2013, but performance since then has been lower despite the introduction of the Common Core State Standards for Mathematics (CCSSM) in the early 2010s. This study examined student…

In 2017, the mathematics assessments that are part of the National Assessment of Educational Progress (NAEP) program underwent a transformation shifting the administration from paper-and-pencil formats to digitally-based assessments (DBA). This shift introduced new interactive item types that bring rich process data and tremendous opportunities to…

"Mathematical Thinking: From Assessment Items to Challenging Tasks" is a compilation of 36 problem-based lessons that encourage students to engage in productive struggle and deep thinking. Its 36 full-length lessons for grades 2-8 are each inspired by an actual test item from the National Assessment of Educational Progress (NAEP).…

The present study examines the features and quality of visual representations (VRs) created by middle school students with learning disabilities and difficulties in mathematics in response to a released fraction item from the National Assessment of Educational Progress (NAEP). Relations between VR quality and scores on other measures of fraction…

The link between reading and mathematics achievement is well known, and an important question is whether readability factors in mathematics problems are differentially impacting student groups. Using 20 years of data from the National Assessment of Educational Progress and the Trends in International Mathematics and Science Study, we examine how…

Today's world is shaped by technology and products engineered to serve society's needs and wants. The knowledge and skills required to develop and use these products are changing at an exponential rate (NASE&M, 2017; NRC, 2011). In order to understand and meet future challenges, it is vital that the United States produce technology- and…

The Alabama State Department of Education (ALSDE) was grappling with several issues including: (1) A respectable rate of growth in student achievement for both fourth- and eighth-grade math in the state of Alabama, as measured by the National Assessment of Educational Progress (NAEP), but below the national average; and (2) A growing concern about…