Propensity score methods account for selection bias in observational studies. However, the consistency of the propensity score estimators strongly depends on a correct specification of the propensity score model. Logistic regression and, with increasing popularity, machine learning tools are used to estimate propensity scores. We introduce a…

A new design-based theory has recently been developed to estimate impacts for randomized controlled trials (RCTs) and basic quasi-experimental designs (QEDs) for a wide range of designs used in social policy research (Imbens & Rubin, 2015; Schochet, 2016). These methods use the potential outcomes framework and known features of study designs…

This NCEE Technical Methods Paper compares the estimated impacts of an educational intervention using experimental and regression discontinuity (RD) study designs. The analysis used data from two large-scale randomized controlled trials--the Education Technology Evaluation and the Teach for America Study--to provide evidence on the performance of…

Apprentice and trainee data are reported by the State and Territory Training Authorities to the National Centre for Vocational Education Research (NCVER) on a quarterly basis, starting at the September quarter of 1994. The set of data submitted that quarter is referred to as Collection 1. The sets of data submitted in subsequent quarters are…

This report examines the differences in impact estimates and standard errors that arise when these are derived using state achievement tests only (as pre-tests and post-tests), study-administered tests only, or some combination of state- and study-administered tests. State tests may yield different evaluation results relative to a test that is…

This paper addresses two audiences--those who design education trend studies that simultaneously have longitudinal and intercohort implications, and the secondary analysts who use such trend data. Four study series conducted for the U.S. Department of Education's National Center for Education Statistics (NCES) provide material for the paper: the…

The data and computational procedures used by the IDEA system at Kansas State University (during the 1976-77 academic year) to interpret ratings of teacher performance are described in this technical report. The computations for each of the seven parts (evaluation, course description, students' self ratings, methods, additional questions,…

The data and computational procedures used by the IDEA System during the 1977-78 academic year at Kansas State University to interpret ratings of teacher performance are described in this technical report. The computations for each of the seven parts (evaluation, course description, students' self-ratings, methods, additional questions, diagnostic…

The data and computational procedures used by the IDEA System to generate IDEA Reports from information collected on the Standard Form of the IDEA Survey Form are described in this technical report. The computations for each of the seven parts of the IDEA Report are explained. The data base used for this 1978-79 Kansas State University study…