The gold-standard for evaluating the effect of an educational intervention on student outcomes is running a randomized controlled trial (RCT). However, RCTs may often be small due to logistical considerations, and resulting treatment effect estimates may lack precision. Recent methods improve experimental precision by incorporating information…

Recent methods have sought to improve precision in randomized controlled trials (RCTs) by utilizing data from large observational datasets for covariate adjustment. For example, consider an RCT aimed at evaluating a new algebra curriculum, in which a few dozen schools are randomly assigned to treatment (new curriculum) or control (standard…

Certain stereotypes can be associated with people from different countries. For example, the Italians are expected to be emotional, the Germans functional, and the Chinese hard-working. In this study, we cluster all 15-year-old students representing the 68 different nations and territories that participated in the latest Programme for…

Some universities administer standardized tests to estimate school effects on student learning. To that end, many of those institutions choose to gather cross-sectional data (freshmen and seniors in the same academic year) rather than longitudinal data. The effects of this decision on institutional assessment results are generally unknown. The…

In recent years, the educational data mining and user modeling communities have been aggressively introducing models for predicting student performance on external measures such as standardized tests as well as within-tutor performance. While these models have brought statistically reliable improvement to performance prediction, the real world…

With the demand for a demonstration of continuous progress as an accountability gauge in public schools, teachers are compelled to examine assessment data for each of their pupils. This data analysis, in turn, should help teachers gauge their instructional practices and differentiate instruction so that all can reach proficient levels of…

Greater Clark Schools in Indiana enrolled with a STEM education program, Shining Star with Indiana University, integrated Nova 5000 data-loggers in their curriculum reported success improving students' standardized exam scores and interest in science and mathematics courses after a three year period. The success of the data-loggers, determined by…

U.S. teacher educators are faced with serious challenges to demonstrate the quality of the graduates they prepare. These challenges are expressed in the country's fixation on accountability and testing. We are witnessing the growth of standardized tests and alternative routes to certification as panaceas intended to solve the teacher shortage…

Issues related to achieving adequate national norms are reviewed, and a new methodology is proposed that would work to provide a true measure of national achievement levels on an annual basis and would enable reporting results in current-year norms. Statistical methodology and technology could combine to create a national norming process that…

The purpose of the study was to compare reliability estimates for a test composed of stimulus-dependent testlets as derived from item scores, testlet scores, and under the univariate generalizability theory and multivariate generalizability theory designs, as well as to determine the influence of the number of testlets and the number of items per…

This paper presents the research design for a longitudinal study of elementary school students, which will examine patterns of cognitive, affective, and social growth and identify the school and home variables which influence such growth. Shifts in dependent variables during a single school year will be examined during the initial year for all…

A strategy that has been initiated to respond to assertions that out-of-date norms distort standardized achievement test results involves annually updating the norms for achievement tests to avoid the production of inflated scores through aging norms. The effect of the application of normative trend data to the obtained test results in an urban…

The special characteristics of the data from the National Assessment of Educational Progress (NAEP) that affect the validity of conventional techniques of statistical analysis are considered. In contrast to the assumptions underlying standard methods of statistical analysis, the NAEP samples are obtained via a stratified multi-stage probability…

This paper identifies and assesses key ideas in data analysis (or statistics) that should be at the focus of middle school mathematics instruction. Items that can be used to assess some of the complex objectives of data analysis are located. The search includes a collection of items released by the National Assessment of Educational Progress…

The paper states and proves three propositions regarding the usefulness of the ITED (Iowa Tests of Educational Development) in preparing adult basic education students to take the GED tests. The first proposition, that the ITED can be a useful practice test for GED candidates, is supported by the fact that the ITED tests are designed to measure…