This article proposes that sampling design effects have potentially huge unrecognized impacts on the results reported by large-scale district and state assessments in the United States. When design effects are unrecognized and unaccounted for they lead to underestimating the sampling error in item and test statistics. Underestimating the sampling…

The Schools and Staffing Survey (SASS) is conducted by the National Center for Education Statistics (NCES) on behalf of the United States Department of Education in order to collect extensive data on American public and private elementary and secondary schools. SASS provides data on the characteristics and qualifications of teachers and…

Research regarding the optimal fielding of online surveys is in its infancy and just beginning to offer clear suggestions for effective recruiting of participants as well as techniques for maximizing the response rate. In this article, the authors discuss the process of recruiting participants by e-mailing invitations to a list of recipients…

This chapter provides an overview of sampling methods that are appropriate for conducting online surveys. The authors review some of the basic concepts relevant to online survey sampling, present some probability and nonprobability techniques for selecting a sample, and briefly discuss sample size determination and nonresponse bias. Although some…

The popularity of the sample survey in educational research makes it necessary for consumers to tell a good study from a poor one. Several sources were identified that gave advice on how to evaluate a sample design. The sources are either limited or too extensive to use in a practical sense. The purpose of this paper is to recommend six important…

An original study with a 96 percent questionnaire return rate and four replications with high return rates were compared in terms of populations sampled, implementation, and results. Future use of this procedure, which includes advance mailing, telephone contact, telephone explanations, and followups, is discussed. (SLD)

Possible bias due to sampling problems or low response rates has been a troubling "nuisance" variable in empirical research since seminal and classical studies were done on these problems at the beginning of this century. Recent research suggests that: (1) earlier views of the alleged bias problem were misleading; (2) under a variety of fairly…

This chapter summarizes the most recent literature on the best practices of Web survey implementation and offers practical advice for researchers. (Contains 1 table.)

The Schools and Staffing Survey (SASS) is a periodic, integrated system of sample surveys on elementary and secondary schools in the United States that collects information on school and district administrators and teachers in public and private schools. This technical report is one in a series of methodological studies relating to the SASS of the…

Nonresponse issues are investigated for the base year (1988) survey of the United States Department of Education's National Education Longitudinal Study of 1988 (NELS:88), a national probability sample of middle schools and eighth-grade students in the spring of 1988. The total eighth-grade enrollment for the NELS:88 sample of schools was 203,002;…

The nine-volume Survey Kit is designed to help readers prepare and conduct surveys and become better users of survey results. All the books in the series contain instructional objectives, exercises and answers, examples of surveys in use, illustrations of survey questions, guidelines for action, checklists of "dos and don'ts," and…

People who care about young people are aware of the serious problems caused by underage alcohol use. They should also be aware that there are many effective strategies for reducing underage drinking, and every state and community should be using these strategies. The "Guide to Conducting Youth Surveys" provides information about one important tool…