NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
ERIC Number: EJ1185547
Record Type: Journal
Publication Date: 2018-Aug
Pages: 28
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0049-1241
EISSN: N/A
Available Date: N/A
Design Effects of Multilevel Estimates from National Probability Samples
Stapleton, Laura M.; Kang, Yoonjeong
Sociological Methods & Research, v47 n3 p430-457 Aug 2018
This research empirically evaluates data sets from the National Center for Education Statistics (NCES) for design effects of ignoring the sampling design in weighted two-level analyses. Currently, researchers may ignore the sampling design beyond the levels that they model which might result in incorrect inferences regarding hypotheses due to biased standard error estimates; the degree of bias depends on the informativeness of any ignored stratification and clustering in the sampling design. Some multilevel software packages accommodate first-stage sampling design information for two-level models but not all. For five example public release data sets from the NCES, design effects of ignoring the sampling design in unconditional and conditional two-level models are presented for 15 dependent variables selected based on a review of published research using these five data sets. Empirical findings suggest that there are minor effects of ignoring the additional sampling design and no differences in inference would be made had the first-stage sampling design been ignored. Strategically, researchers without access to multilevel software that can accommodate the sampling might consider including stratification variables as independent variables at level 2 of their model.
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com.bibliotheek.ehb.be
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Secondary Education
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Early Childhood Longitudinal Survey; Schools and Staffing Survey (NCES); Trends in International Mathematics and Science Study
IES Funded: Yes
Grant or Contract Numbers: R305D110050
Author Affiliations: N/A