Automatic item generation may supply many items instantly and efficiently to assessment and learning environments. Yet, the evaluation of item quality persists to be a bottleneck for deploying generated items in learning and assessment settings. In this study, we investigated the utility of using large-language models, specifically Llama 3-8B, for…

With the advent of big data and advances in technology, psychological assessments have become increasingly sophisticated and complex. Nevertheless, traditional psychometric issues concerning the validity, reliability, and measurement bias of such assessments remain fundamental in determining whether score inferences of human attributes are…

With the exponential increase in the volume of data available in the 21st century, data literacy skills have become vitally important in work places and everyday life. This paper provides a systematic review of available data literacy assessments targeted at different audiences and educational levels. The results can help researchers and…

Summit Public Schools (SPS), a California-based charter school network established in 2003, is widely promoted nationally as a success story to be emulated. A policy environment friendly to charter schools and digital technologies, together with hundreds of millions of dollars in technology industry contributions, enabled its growth and its…

Nurturing student artificial intelligence (AI) competency is crucial in the future of K-12 education. Students with strong AI competency should be able to ethically, safely, healthily, and productively integrate AI into their learning. Research on student AI competency is still in its infancy, primarily focusing on theoretical and professional…

The growing interest of educational researchers in computational thinking (CT) has led to an expanding literature on assessments of CT skills and attitudes. However, few studies have examined whether CT attitudes influence CT skills. The present study examines the relationship between CT attitudes and CT skills for preservice teachers (PSTs). The…

Student agency, or the ability to manage one's learning, can have significant effects on academic achievement as students take an active role in seeking and internalizing new knowledge. Students who believe that knowledge can grow over time perform better on IQ tests than students who believe intelligence is invariable (Cury, Elliot, Da Fonseca,…

Although there is a strong legislative base and perceived efficacy for multidisciplinary team decision making, limited evidence supports its effectiveness or consistency of implementation in practice. In recent research, we used the Decision Observation, Recording, and Analysis (DORA) tool to document activities and adult behaviors during positive…

The Early Fractions Test v2.2 is a paper-pencil test designed to measure mathematics achievement of third- and fourth-grade students in the domain of fractions. The purpose, or intended use, of the Early Fractions Test v2.2 is to serve as a measure of student outcomes in a randomized trial designed to estimate the effect of an educational…

This dissertation is developed around two studies created with the goal of describing and quantifying current educators' knowledge and perceptions of reading assessment and subsequent data-based instructional decision making. Unique to the field, a critical component of this study is an emphasis on educators' development of "data…

School teams regularly meet to review academic and social problems of individual students, groups of students, or their school in general. While the need for problem solving and recommendations for how to do it are widely documented, there is very limited evidence reflecting the extent to which teams effectively engage in a systematic or effective…

The authors argue that the current state of applied data-based test analytic practice is unstructured and unmethodical due in large part to the fact that there is no clearly specified, widely accepted test analytic framework for judging the performances of particular tests in particular contexts. Drawing from the extant test theory literature,…

Data driven decision making emphasizes the importance of the teacher using objective sources of information in developing the social studies curriculum. Too frequently, decisions of teachers have been made based on routine and outdated methods of teaching. Valid and reliable tests used to secure results from pupil learning make for better…

The purpose of this study was to investigate the quality (reliability and validity) of large-scale fitness testing in Texas and determine if reliabilities and validities were related to potential confounding variables. Four test administration scenarios were conducted to investigate the quality of data collected statewide as part of the Texas…

State test scores administered for accountability purposes are regularly used to adjust instruction in nuanced ways. This is no accident--No Child Left Behind demanded that students' scores be returned quickly to teachers in order that this might be the case, and the idea of data-driven decision making continues as one way the promise of education…