Missing data are common with large scale assessments (LSAs). A typical approach to handling missing data with LSAs is the use of listwise deletion, despite decades of research showing that approach can be a suboptimal strategy resulting in biased estimates. In order to help researchers account for missing data, we provide a tutorial using R and…

Presents a statistical technique that yields consistent estimates for censored samples. Application of this technique to models related to selection bias and the presence of depression indicate that the prevalence of this disorder in mental health center populations approaches 44 percent rather than the 25 percent from a censored sample.…

The primary objective of this paper is to encourage survey researchers not to become overly reliant on the literature for generic solutions to non-response bias problems. In addition, the paper recounts an example of how a non-traditional approach was used to maximize the usefulness of data collected under unusual constraints and with an a priori…

Canonical correlation analysis is illustrated and three common fallacious interpretation practices are described. Simply, canonical correlation is an example of the bivariate case. Like all parametric methods, it involves the creation of synthetic scores for each person. It presumes at least two predictor variables and at least two criterion…

Qualitative research evokes rather stereotyped responses from the mainstream of social science. The following 10 standardized responses to the stimulus "qualitative research interview" (QRI) are discussed: (1) it is not scientific, only common sense; (2) it is not objective, but subjective; (3) it is not trustworthy, but biased; (4) it is not…

Discusses the difficulties of defining races and establishing statistical differences between such groups. Points out that studies of such aspects as temperament or basic personality traits show much more variation within groups than between groups. Investigators of such questions should be especially careful to use sound methodology and cautious…

Quality assurance and evaluation research, like other fields of social research and its application, are confronted with a series of problems. In the present paper, I want first to give a list of such problems, although necessarily incomplete. It is then claimed that while there is no "perfect" solution to these problems, critical multiplism may…

The efficacy of the random digit dialing method in telephone surveys was examined. Random digit dialing (RDD) generates a pure random sample and provides the advantage of including unlisted phone numbers, as well as numbers which are too new to be listed. Its disadvantage is that it generates a major proportion of nonworking and business…

the factors which maximize response rates, both through reducing refusals and increasing the probability that respondents will be available for interview, were studied in rural California. Phone directories were used to generate a sample of 250 households who were contacted on either of two evenings or Saturday. The interview questions concerned…

Even though attrition presents a serious threat to the validity of longitudinal research, there is a lack of standardization for reporting it. To examine the effectiveness of four tests for attrition -- two for external validity and two for internal validity -- the tests were applied to two large scale projects: the first, Project HASP, is a…

Asserts that traditional approaches to multivariate analysis, including standard linear regression techniques, ignore the special character of count data. Explicates three suitable alternatives to standard regression techniques, a simple Poisson regression, a modified Poisson regression, and a negative binomial model. (MJP)

To correct for the effects of measurement error on structural parameter estimates, many researchers are now estimating models of educational achievement with LISREL. In order to estimate such models it is desirable to obtain multiple manifest measures of the latent constructs. Many researchers restrict their models to two manifest measures per…

In September 1984, a Vocational Education Data System (VEDS) follow-up survey was conducted of all 5,267 students who had graduated from Massachusetts public community colleges in 1982-83. Of these graduates, 1,881 (35.7%) returned the survey, and 3,386 (64.3%) did not. A subsequent study was conducted to compare the characteristics of survey…

This paper evaluates the logic underlying various criticisms of statistical significance testing and makes specific recommendations for scientific and editorial practice that might better increase the knowledge base. Reliance on the traditional hypothesis testing model has led to a major bias against nonsignificant results and to misinterpretation…

The sampling of teachers for nationwide surveys offers a challenging endeavor in obtaining a representative and adequate sample to truly represent opinions of the teachers. Ten national surveys of public school teachers conducted between 1980 and 1985 are presented with respect to their sampling design and procedures. Concepts and theoretical…