Multiple matrix sampling is a sampling design in which both test items and examinees are randomly sampled from their respective populations. This study was designed to develop and assess a method for computing an estimate of a correlation coefficient when a multiple matrix sampling design is used. The examinee populations included 212 third-grade…

A method is proposed for sequential evaluation of reliability of psychometric instruments. Sample size is unfixed; a test statistic is computed after each person is sampled and a decision is made in each stage of the sampling process. Results from a series of Monte-Carlo experiments establish the method's efficiency. (SLD)

Provides details on the instrument development, sample design, data collection, and data analysis procedures of the 1996 National Assessment of Educational Progress (NAEP) long-term trend and main assessments for the United States. (Author/SLD)

This manual was developed to assist school jurisdiction personnel in implementing effective customer satisfaction surveys by telephone or through mailed surveys to be completed by the customer. It provides background information about market research field activities and processes and gives an overview of the entire data collection process,…

The National Education Longitudinal Studies Program (NELS) is a long-term effort that encompasses the educational experience of youth from three decades. This report is based on the National Education Longitudinal Study of 1988 (NELS:88), a component of the NELS series that began as a national probability sample of eighth grade schools and…

A problem that arises when a differential item functioning (DIF) study is done with samples of examinees differing in ability is examined. A test may function differently when the populations from which the items are calibrated are not of equal ability. Since the lower ability examinees get many difficult items incorrect, the spread (standard…

This study investigated the extent to which log-linear smoothing could improve the accuracy of common-item equating by the chained equipercentile method in small samples of examinees. Examinee response data from a 100-item test (the Advanced Placement Examination in United States History) were used to create two overlapping forms of 58 items each,…

These tips on surveying public opinion are based on the contention that community surveys can be useful to educators who want to know what the community is thinking about education, are ready to respond, and have no qualms about making survey results public. The author first discusses the importance of determination of the community survey's…

Sampling distributions for ten tests for comparing population variances in a two group design were generated for several combinations of equal and unequal sample sizes, population means, and group variances when distributional forms differed. The ten procedures included: (1) O'Brien's (OB); (2) O'Brien's with adjusted degrees of freedom; (3)…

By means of computer simulation of test responses, the reliability of item analysis data and the accuracy of equating were examined for hypothetical samples of 250, 500, 1000, and 2000 subjects for two tests with 20 equating items plus 60 additional items on the same scale. Birnbaum's three-parameter logistic model was used for the simulation. The…

From a priori and post hoc data collection perspectives, this paper describes the interrelations among (1) power, alpha, effect size, and sample size for hypothesis testing; and (2) precision, confidence, and sample size for interval estimation. Implications for special education researchers working with convenient samples of fixed size are…

The 1988 National Survey of Postsecondary Faculty (NSOPF-88), later named the National Study of Postsecondary Faculty, was the first comprehensive study of higher education instructional faculty conducted by the National Center for Education Statistics since 1963. This report provides a description of the 1993 NSOPF and the data generated by its…

Suggests activities using large samples to simulate quality control processes in industry (specifically, manufacturing camera film). A series of small-group activities investigate the relationship of sample size to percent defective in batch sampling. Efficiency, cost of sampling, company reputation, and public relations are business factors…

A rationale is presented for the use of many cases in policy analysis. Case study families were selected from nomination by early intervention professionals in three states with differing early intervention policies and procedures. Using rating scales, demographic data, and interview transcripts with 72 families of children receiving services, 7…

The contrasting groups method is one of many possible methods for setting passing scores. The most commonly used method is probably that developed by W. H. Angoff (1971), but it has been suggested that the Angoff method may not be appropriate for many standard setting applications in education. The contrasting groups method is explored as an…