Recent developments in the field of artificial intelligence allow for improved performance in the automated assessment of extended response items in mathematics, potentially allowing for the scoring of these items cheaply and at scale. This study details the grand prize-winning approach to developing large language models (LLMs) to automatically…

This study aimed to examine an assumption regarding whether generative artificial intelligence (GAI) tools can overcome the cognitive intensity that humans suffer when solving problems. We examine the performance of ChatGPT and GPT-4 on NAEP science assessments and compare their performance to students by cognitive demands of the items. Fifty-four…

In 2024, the National Center for Education Statistics (NCES) administered the National Assessment of Educational Progress (NAEP) mathematics assessment to representative samples of fourth- and eighth-grade students in the nation, states, the District of Columbia, Puerto Rico, Department of Defense schools, and 26 participating large urban…

In this study, we explore the application of process mining techniques on assessment log data to explore problem-solving strategies in Algebra. By analyzing sequences of student activities, we demonstrate the significant potential of process mining in identifying problem-solving strategies that lead to successful and unsuccessful outcomes. Our…

The objective of this dissertation was to explore the paradoxical nature of Combinatorics as both a difficult and accessible domain in Mathematics, particularly for K-12 students. This paradox in Combinatorics' nature raised questions about how students interact with problems in this domain and the factors influencing their understanding and…

The COVID-19 pandemic has affected student learning; according to the National Assessment of Educational Progress (2022), scores for students in the United States have shown a decline in mathematics. . One way educators can strengthen students' current mathematical knowledge and bridge to new content is through Number Talks. Number Talks are brief…

The recent integration of visual capabilities into Large Language Models (LLMs) has the potential to play a pivotal role in science and technology education, where visual elements such as diagrams, charts, and tables are commonly used to improve the learning experience. This study investigates the performance of ChatGPT-4 Vision, OpenAI's most…

Grades 4 and 8 students had shown slow but steady improvement in scores on the National Assessment of Educational Progress (NAEP) mathematics assessment from 1990 until 2013, but performance since then has been lower despite the introduction of the Common Core State Standards for Mathematics (CCSSM) in the early 2010s. This study examined student…

In 2017, the mathematics assessments that are part of the National Assessment of Educational Progress (NAEP) program underwent a transformation shifting the administration from paper-and-pencil formats to digitally-based assessments (DBA). This shift introduced new interactive item types that bring rich process data and tremendous opportunities to…

The project team for the National Monitoring Study of Student Achievement (NMSSA) has recently begun writing reports focussed on how insights generated by the study can be used to promote learning and teaching. The reports are written primarily for teachers. This short article introduces the reports with a special emphasis on the mathematics and…

This paper explores the complex problem of project sustainability, focusing on the leadership of three primary school mathematics leaders. Using cultural-historical activity theory (CHAT), the leaders' efforts are reported, highlighting their contribution to project sustainability. The CHAT-informed research design supported the generation of…

High Order Thinking Skills (HOTS) are a significant part of the implementation of the 2013 Curriculum to develop student competencies in the 21st century. Not only in the context of learning are HOTS considered important. They contribute to the National Examination held in Indonesia, so careful preparation for this exam is needed. Chemistry has…

A more motivating way of introducing students to probability theory is through real-world problems. Since heuristics play an important role in our probabilistic judgement, knowing how to avoid incorrect probabilistic reasoning, which leads to several biases, could help students to develop more critical thinking skills. In this paper, we present a…

The present study examines the features and quality of visual representations (VRs) created by middle school students with learning disabilities and difficulties in mathematics in response to a released fraction item from the National Assessment of Educational Progress (NAEP). Relations between VR quality and scores on other measures of fraction…

The purpose of this study was to explore geometry spatial mathematical reasoning in Grade nine Annual National Assessments, South Africa. Conceptual Blending was the guiding theory. Document analysis within the exploratory case study was used to explore available data, the 2014 Annual National Assessment learners' scripts (n=1250). Results…