Gateway science courses are an ongoing obstacle to recruitment into STEM fields (Science, Technology, Engineering, and Mathematics). Students come into courses that have a high cognitive load, which makes success in the course challenging. Instructional design can be used to reduce cognitive load. The findings demonstrate that leveraging pre- and…

In this paper we investigate the impact of a statewide program aimed at better aligning K-12 to higher education and improving college readiness. We replicate an earlier study focused on the effects of this program at one campus by employing detailed administrative data on the census of California students that enroll at all twenty-three campuses…

We designed and implemented a modified eight-week Direct Instruction (DI) program intended to teach a third grade student with learning disabilities to tell time. The first objective was to determine whether or not the appearance (interesting or boring) of the worksheet affected performance. These data suggested the use of large-scale clocks and…

The aim of the study was to examine the effect of a 4-week classroom physical activity break intervention on middle school students' health-related physical fitness. The study was a randomized controlled trial with students assigned to the experiment and control conditions. A convenience sample comprised 94 adolescents (experiment group n = 52;…

This study analyzed data from four evaluation designs incorporating the retrospective pretest (i.e., thentest), analyzing the effects of self-report pretesting and post-program survey format on a set of self-report measures. Validity of self-report data was assessed by comparing the criterion validity of then ratings to established benchmarks and…

The effects of a mathematical problem-solving intervention on students' problem-solving performance and math achievement were measured in a randomized control trial with 1,059 7th-grade students. The intervention, "Solve It!," is a research-based cognitive strategy instructional intervention that was shown to improve the problem-solving…

Interim assessments are increasingly common in U.S. schools. We use high-quality data from a large-scale school-level cluster randomized experiment to examine the impact of two well-known commercial interim assessment programs on mathematics and reading achievement in Indiana. Results indicate that the treatment effects are positive but not…

With the need for larger and larger banks of items to support adaptive testing and to meet security concerns, large-scale item generation is a requirement for many certification and licensure programs. As part of the mass production of items, it is critical that the difficulty and the discrimination of the items be known without the need for…

As part of an NSF funded project we developed new course materials for a general introductory statistics course designed to engage students in statistical discovery. The materials were designed to actively involve students in the design and implementation of data collection and the analysis and interpretation of the resulting data. Our overall…

The iPod digital music player has been available since late 2001, and even in higher education, its presence has been seen, although mostly in the hands of students and rarely for outcomes-based educational purposes. In 2004, Duke University provided free iPods to all 1,650 first year students, which subsequently enabled faculty to create learning…

A quantitative method, meta-analysis, is used to integrate research findings from a representative group of 38 coaching studies. Because different studies reported results on different scales, effect size was used to transform all results to a common metric. This meta-analysis showed that there are two distinct literatures on the effectiveness of…

The Program Standards Evaluation System was developed in response to evaluation requirements in the 1973 Rehabilitation Act. The system includes procedures for using standards data to monitor and evaluate vocational rehabilitation (VR) service outcomes and outputs as well as standards on key procedural issues. The system includes procedures for…

A statistical method, Fishers Table of t (or t ratio), is used to determine the statistical significance of a comparison of results from pretests and post-tests of knowledge and skill taken by training program participants. A statistically significant improvement can demonstrate training effectiveness. (MS)