Recent developments in the field of artificial intelligence allow for improved performance in the automated assessment of extended response items in mathematics, potentially allowing for the scoring of these items cheaply and at scale. This study details the grand prize-winning approach to developing large language models (LLMs) to automatically…

This study aimed to examine an assumption regarding whether generative artificial intelligence (GAI) tools can overcome the cognitive intensity that humans suffer when solving problems. We examine the performance of ChatGPT and GPT-4 on NAEP science assessments and compare their performance to students by cognitive demands of the items. Fifty-four…

The COVID-19 pandemic has affected student learning; according to the National Assessment of Educational Progress (2022), scores for students in the United States have shown a decline in mathematics. . One way educators can strengthen students' current mathematical knowledge and bridge to new content is through Number Talks. Number Talks are brief…

The recent integration of visual capabilities into Large Language Models (LLMs) has the potential to play a pivotal role in science and technology education, where visual elements such as diagrams, charts, and tables are commonly used to improve the learning experience. This study investigates the performance of ChatGPT-4 Vision, OpenAI's most…

In 2017, the mathematics assessments that are part of the National Assessment of Educational Progress (NAEP) program underwent a transformation shifting the administration from paper-and-pencil formats to digitally-based assessments (DBA). This shift introduced new interactive item types that bring rich process data and tremendous opportunities to…

The project team for the National Monitoring Study of Student Achievement (NMSSA) has recently begun writing reports focussed on how insights generated by the study can be used to promote learning and teaching. The reports are written primarily for teachers. This short article introduces the reports with a special emphasis on the mathematics and…

High Order Thinking Skills (HOTS) are a significant part of the implementation of the 2013 Curriculum to develop student competencies in the 21st century. Not only in the context of learning are HOTS considered important. They contribute to the National Examination held in Indonesia, so careful preparation for this exam is needed. Chemistry has…

A more motivating way of introducing students to probability theory is through real-world problems. Since heuristics play an important role in our probabilistic judgement, knowing how to avoid incorrect probabilistic reasoning, which leads to several biases, could help students to develop more critical thinking skills. In this paper, we present a…

The present study examines the features and quality of visual representations (VRs) created by middle school students with learning disabilities and difficulties in mathematics in response to a released fraction item from the National Assessment of Educational Progress (NAEP). Relations between VR quality and scores on other measures of fraction…

The purpose of this study was to explore geometry spatial mathematical reasoning in Grade nine Annual National Assessments, South Africa. Conceptual Blending was the guiding theory. Document analysis within the exploratory case study was used to explore available data, the 2014 Annual National Assessment learners' scripts (n=1250). Results…

In the study reported on here I evaluated the alignment between the Annual National Assessment (ANA) and Trends in International Mathematics and Science Study (TIMSS). Theoretical perspectives were drawn from the Survey Enacted Curriculum (SEC), while quantitative correlational methods were used to determine the alignment between ANA and TIMSS…

This study was aimed to investigate effect of National Examination (UN) and curriculum also their interaction effect on students' performance in solving TIMSS model Mathematics problems. This study was carried out with 300 8th graders of East Kalimantan students. The participants were from three mathematics National Examination result school…

Today's world is shaped by technology and products engineered to serve society's needs and wants. The knowledge and skills required to develop and use these products are changing at an exponential rate (NASE&M, 2017; NRC, 2011). In order to understand and meet future challenges, it is vital that the United States produce technology- and…

In this article, we use multimodality to examine how bilingual students interact with an area task from the National Assessment of Educational Progress in task-based interviews. Using vignettes, we demonstrate how some of these students manipulate the concrete materials, and use gestures, as a primary form of structuring their explanations and…

Internationally, education reform has been directed towards describing educational goals that go beyond topic and content descriptions. The idea of mathematical competencies describes such goals. National tests have been seen as one way of communicating these goals and influence teaching. The present study analyses Swedish national tests in…