This study aimed to examine an assumption regarding whether generative artificial intelligence (GAI) tools can overcome the cognitive intensity that humans suffer when solving problems. We examine the performance of ChatGPT and GPT-4 on NAEP science assessments and compare their performance to students by cognitive demands of the items. Fifty-four…

This exploratory study investigated the behaviors and content of onscreen calculator usage by a nationally representative sample of eighth-grade students who responded to items from the 2017 National Assessment of Educational Progress mathematics assessment. Meaningful features were generated from the process data to infer whether students…

In this study, we explore the application of process mining techniques on assessment log data to explore problem-solving strategies in Algebra. By analyzing sequences of student activities, we demonstrate the significant potential of process mining in identifying problem-solving strategies that lead to successful and unsuccessful outcomes. Our…

The COVID-19 pandemic has affected student learning; according to the National Assessment of Educational Progress (2022), scores for students in the United States have shown a decline in mathematics. . One way educators can strengthen students' current mathematical knowledge and bridge to new content is through Number Talks. Number Talks are brief…

Grades 4 and 8 students had shown slow but steady improvement in scores on the National Assessment of Educational Progress (NAEP) mathematics assessment from 1990 until 2013, but performance since then has been lower despite the introduction of the Common Core State Standards for Mathematics (CCSSM) in the early 2010s. This study examined student…

In 2017, the mathematics assessments that are part of the National Assessment of Educational Progress (NAEP) program underwent a transformation shifting the administration from paper-and-pencil formats to digitally-based assessments (DBA). This shift introduced new interactive item types that bring rich process data and tremendous opportunities to…

"Mathematical Thinking: From Assessment Items to Challenging Tasks" is a compilation of 36 problem-based lessons that encourage students to engage in productive struggle and deep thinking. Its 36 full-length lessons for grades 2-8 are each inspired by an actual test item from the National Assessment of Educational Progress (NAEP).…

The present study examines the features and quality of visual representations (VRs) created by middle school students with learning disabilities and difficulties in mathematics in response to a released fraction item from the National Assessment of Educational Progress (NAEP). Relations between VR quality and scores on other measures of fraction…

The link between reading and mathematics achievement is well known, and an important question is whether readability factors in mathematics problems are differentially impacting student groups. Using 20 years of data from the National Assessment of Educational Progress and the Trends in International Mathematics and Science Study, we examine how…

Today's world is shaped by technology and products engineered to serve society's needs and wants. The knowledge and skills required to develop and use these products are changing at an exponential rate (NASE&M, 2017; NRC, 2011). In order to understand and meet future challenges, it is vital that the United States produce technology- and…

The Alabama State Department of Education (ALSDE) was grappling with several issues including: (1) A respectable rate of growth in student achievement for both fourth- and eighth-grade math in the state of Alabama, as measured by the National Assessment of Educational Progress (NAEP), but below the national average; and (2) A growing concern about…

In this article, we use multimodality to examine how bilingual students interact with an area task from the National Assessment of Educational Progress in task-based interviews. Using vignettes, we demonstrate how some of these students manipulate the concrete materials, and use gestures, as a primary form of structuring their explanations and…

The main purposes of this study were to test the effects of teaching at-risk 4th graders to provide explanations for their mathematics work and examine whether those effects occur by compensating for limitations in cognitive processes. We randomly assigned 212 children to 3 conditions: a control group and 2 variants of a multi-component fraction…

New technology enables interactive and adaptive scenario-based tasks (SBTs) to be adopted in educational measurement. At the same time, it is a challenging problem to build appropriate psychometric models to analyze data collected from these tasks, due to the complexity of the data. This study focuses on process data collected from SBTs. We…

This study examined the effect of schema-based instruction (SBI) on the proportional problem-solving performance of students with mathematics difficulties only (MD) and students with mathematics and reading difficulties (MDRD). Specifically, we examined the responsiveness of 260 seventh grade students identified as MD or MDRD to a 6-week treatment…