This study aimed to examine an assumption regarding whether generative artificial intelligence (GAI) tools can overcome the cognitive intensity that humans suffer when solving problems. We examine the performance of ChatGPT and GPT-4 on NAEP science assessments and compare their performance to students by cognitive demands of the items. Fifty-four…

This exploratory study investigated the behaviors and content of onscreen calculator usage by a nationally representative sample of eighth-grade students who responded to items from the 2017 National Assessment of Educational Progress mathematics assessment. Meaningful features were generated from the process data to infer whether students…

In this study, we explore the application of process mining techniques on assessment log data to explore problem-solving strategies in Algebra. By analyzing sequences of student activities, we demonstrate the significant potential of process mining in identifying problem-solving strategies that lead to successful and unsuccessful outcomes. Our…

The COVID-19 pandemic has affected student learning; according to the National Assessment of Educational Progress (2022), scores for students in the United States have shown a decline in mathematics. . One way educators can strengthen students' current mathematical knowledge and bridge to new content is through Number Talks. Number Talks are brief…

For autistic students receiving special education services, little is known about their relative strengths, weaknesses, and enjoyment across different math content areas; their overall math interest and persistence are also not well-studied. Using the 2017 eighth-grade National Assessment of Education Progress data, this study finds, relative to…

Grades 4 and 8 students had shown slow but steady improvement in scores on the National Assessment of Educational Progress (NAEP) mathematics assessment from 1990 until 2013, but performance since then has been lower despite the introduction of the Common Core State Standards for Mathematics (CCSSM) in the early 2010s. This study examined student…

In 2017, the mathematics assessments that are part of the National Assessment of Educational Progress (NAEP) program underwent a transformation shifting the administration from paper-and-pencil formats to digitally-based assessments (DBA). This shift introduced new interactive item types that bring rich process data and tremendous opportunities to…

Many large-scale educational surveys have moved from linear form design to multistage testing (MST) design. One advantage of MST is that it can provide more accurate latent trait [theta] estimates using fewer items than required by linear tests. However, MST generates incomplete response data by design; hence, questions remain as to how to…

"Mathematical Thinking: From Assessment Items to Challenging Tasks" is a compilation of 36 problem-based lessons that encourage students to engage in productive struggle and deep thinking. Its 36 full-length lessons for grades 2-8 are each inspired by an actual test item from the National Assessment of Educational Progress (NAEP).…

The present study examines the features and quality of visual representations (VRs) created by middle school students with learning disabilities and difficulties in mathematics in response to a released fraction item from the National Assessment of Educational Progress (NAEP). Relations between VR quality and scores on other measures of fraction…

The link between reading and mathematics achievement is well known, and an important question is whether readability factors in mathematics problems are differentially impacting student groups. Using 20 years of data from the National Assessment of Educational Progress and the Trends in International Mathematics and Science Study, we examine how…

Today's world is shaped by technology and products engineered to serve society's needs and wants. The knowledge and skills required to develop and use these products are changing at an exponential rate (NASE&M, 2017; NRC, 2011). In order to understand and meet future challenges, it is vital that the United States produce technology- and…

The Alabama State Department of Education (ALSDE) was grappling with several issues including: (1) A respectable rate of growth in student achievement for both fourth- and eighth-grade math in the state of Alabama, as measured by the National Assessment of Educational Progress (NAEP), but below the national average; and (2) A growing concern about…

In this article, we use multimodality to examine how bilingual students interact with an area task from the National Assessment of Educational Progress in task-based interviews. Using vignettes, we demonstrate how some of these students manipulate the concrete materials, and use gestures, as a primary form of structuring their explanations and…

The efficacy of a research-based fraction sense intervention for sixth graders with or at risk for mathematics difficulties (N = 52) was examined. The intervention aimed to build understanding of fraction magnitudes on the number line. Key concepts were taught with a narrow range of denominators to develop deep understanding. The intervention was…