Randomized A/B tests within online learning platforms represent an exciting direction in learning sciences. With minimal assumptions, they allow causal effect estimation without confounding bias and exact statistical inference even in small samples. However, often experimental samples and/or treatment effects are small, A/B tests are underpowered,…

This report presents findings on crime and violence in U.S. public schools, using data from the 2015-16 School Survey on Crime and Safety (SSOCS:2016). First administered in school year 1999-2000 and repeated in school years 2003-04, 2005-06, 2007-08, 2009-10, and 2015-16, SSOCS provides information on school crime-related topics from the…

The Programme for International Assessment of Adult Competencies (PIAAC) will establish technical standards and guidelines to ensure that the survey design and implementation processes of PIAAC yield high-quality and internationally comparable data. This document provides a revised version of the technical standards and guidelines originally…

A single group (SG) equating design with nearly equivalent test forms (SiGNET) design was developed by Grant (2006) to equate small volume tests. The basis of this design is that examinees take two largely overlapping test forms within a single administration. The scored items for the operational form are divided into mini-tests called testlets.…

This paper examines the potential for sample bias if the number of followup mailings in a survey is reduced. The results indicate that initial respondents differ from laggard respondents on five demographic characteristics, but differences diminish between early and late laggard respondents. Multiple mailings are necessary to improve the quality…

The National Household Education Survey (NHES) is a data collection system of the National Center for Education Statistics. The NHES is a telephone survey of the noninstitutionalized civilian population using households selected using random digit dialing methods. Approximately 60,000 households are screened for each administration, and people who…

Several statistical rational and empirical procedures are presented for dealing with the problems of non-response or low return rates in surveys, namely mail surveys. Advantages and shortcomings of these procedures in educational research are discussed. (SLD)

Possible bias due to sampling problems or low response rates has been a troubling "nuisance" variable in empirical research since seminal and classical studies were done on these problems at the beginning of this century. Recent research suggests that: (1) earlier views of the alleged bias problem were misleading; (2) under a variety of fairly…

This study was designed to determine the extent to which the results of an employment survey of graduates of a teacher preparation program would have been affected by changes in response rate. At the University of Tennessee, Knoxville, a followup of teacher education program graduates is conducted annually. A total of 284 graduates of the 1992…

Some students are excluded from the National Education Longitudinal Study of 1988 (NELS:88) because of an inability, whether due to physical, mental, or linguistic barriers, to participate in studies requiring questionnaire or cognitive test completion. The implications of this exclusion for sample representativeness, national estimation, and…

The National Household Education Survey (NHES) was conducted for the first time in 1991 as a way to collect data on the early childhood education experiences of young children and participation in adult education. Because the NHES methodology is relatively new, field tests were necessary. A large field test of approximately 15,000 households was…

The extent to which students with disabilities are represented in national data collection programs was investigated by reviewing nine such programs that are receiving attention in current educational reform initiatives. Results suggest that 40-50% of students with disabilities are excluded from these prominent data collection programs. (SLD)