The popularity of generative AI chatbots, such as ChatGPT, has sparked numerous studies investigating their use in educational contexts. However, it is important to note that chatbots are not a new phenomenon; researchers have explored conversational agents across diverse fields for decades. Conversational agents engage users in natural language…

Using exogenous characteristics to identify endogenous subgroups, the approach discussed in this method note creates symmetric subsets within treatment and control groups, allowing the analysis to take advantage of an experimental design. In order to maintain treatment--control symmetry, however, prior work has posited that it is necessary to use…

This three-volume report describes the "SAM (School Administration Manager) process," an approach that about 700 schools around the nation are using to direct more of principals' time and effort to improve teaching and learning in classrooms. Research has shown that a principal's instructional leadership is second only to teaching among…

This article examines theoretical and empirical issues related to the statistical power of impact estimates for experimental evaluations of education programs. The author considers designs where random assignment is conducted at the school, classroom, or student level, and employs a unified analytic framework using statistical methods from the…

This study examined the relationship between data use and achievement at 13 urban Title I schools. Using multiple methods, including test scores, district surveys, school transformation plans, and four case study site visits, the researchers found wide variation in the use of data to inform instruction and planning. In some cases, schools were …

This report summarizes the National Job Training Partnership Act (JTPA) Study, which examined the impact of Title IIA of JTPA on participants' employment, earnings, and welfare receipt. Between 1987 and 1989, more than 20,000 adults and out-of-school youths who applied for JTPA services in 16 areas across the country were randomly assigned to a…

In August 1996 Jay P. Greene, Paul E. Peterson, and Jiangtao Du, with Leesa Boeger and Curtis L. Frazier, issued a report called "The Effectiveness of School Choice in Milwaukee." The report, referred to as GPDBF, presented data that indicated that low-income minority students in their third and fourth years of participation in the…

A statistical definition of information utilization for policy making decisions and an evaluation impact test to determine its occurrence are proposed. A univariate time series analysis is used to identify the internal trend for a given policy output variable and to control its effect. Two problems are identified in implementing an evaluation…

Although sampling has been mentioned as part of the chance and data component of the mathematics curriculum since about 1990, little research attention has been aimed specifically at school students' understanding of this descriptive area. This study considers the initial understanding of bias in sampling by 639 students in grades 3, 5, 7, and 9.…

The National Job Corps Study was conducted in 1994-1996 to provide a thorough and rigorous assessment of the impacts of the Job Corps on key participant outcomes. To ensure that the study was well implemented, a study team from Mathematica Policy Research, Inc., (MPR) investigated outcome and admission (OA) procedures in each Job Corps region and…