This study was designed to determine the extent to which the results of an employment survey of graduates of a teacher preparation program would have been affected by changes in response rate. At the University of Tennessee, Knoxville, a followup of teacher education program graduates is conducted annually. A total of 284 graduates of the 1992…

This manual was developed to assist school jurisdiction personnel in implementing effective customer satisfaction surveys by telephone or through mailed surveys to be completed by the customer. It provides background information about market research field activities and processes and gives an overview of the entire data collection process,…

The National Education Longitudinal Studies Program (NELS) is a long-term effort that encompasses the educational experience of youth from three decades. This report is based on the National Education Longitudinal Study of 1988 (NELS:88), a component of the NELS series that began as a national probability sample of eighth grade schools and…

A previous multivariate analysis of variance (MANOVA) study of attitudes toward interactive video (ITV) of participants in distance education had indicated that generalized variance was not homogeneous across all groups. Since heterogeneity of variance in MANOVA has previously been shown to change Type I error rates in unequal group size, detected…

The use of scientific calculators on standardized mathematics tests is becoming more common, and how their use affects the standardized testing process continues to be a topic of study. This study extends previous work by examining test item characteristics and equity issues, asking whether items designed to be "calculator neutral"…

Selected methodological characteristics of meta-analyses related to educational achievement are reviewed in an exploration of the practice of meta-analysis and the characteristics of meta-analyses related to educational achievement, as well as possible relationships among background, methodological and substantive characteristics, and effect…

A problem that arises when a differential item functioning (DIF) study is done with samples of examinees differing in ability is examined. A test may function differently when the populations from which the items are calibrated are not of equal ability. Since the lower ability examinees get many difficult items incorrect, the spread (standard…

This study investigated the extent to which log-linear smoothing could improve the accuracy of common-item equating by the chained equipercentile method in small samples of examinees. Examinee response data from a 100-item test (the Advanced Placement Examination in United States History) were used to create two overlapping forms of 58 items each,…

Standard errors and bias of unidimensional and multidimensional ability estimates were compared in a factorial, simulation design with two item response theory (IRT) approaches, two levels of test correlation (0.42 and 0.63), two sample sizes (500 and 1,000), and a hierarchical test content structure. Bias and standard errors of subtest scores…

The empirical performance of the technique proposed by P. O. Johnson and J. Neyman (1936) (the JN technique) and the modification of R. F. Potthoff (1964) was studied in simulated data settings. The robustness of the two JN techniques was investigated with respect to their ability to control Type I and Type III errors. Factors manipulated in the…

This document provides technical information about the "Faculty at Work" questionnaire for those considering using it in their institution. The "Faculty at Work" questionnaire was designed to gather data on a number of factors that are important elements of faculty motivation and may help plan for professional development…

Speedback is a continuous audience response technology system that was used to test concepts and variable relationships that had been derived earlier from large-sample, survey research methodology. Continuous audience response technologies used computer hardware and customized software to collect subjects' reactions to stimuli, usually videotaped…

These tips on surveying public opinion are based on the contention that community surveys can be useful to educators who want to know what the community is thinking about education, are ready to respond, and have no qualms about making survey results public. The author first discusses the importance of determination of the community survey's…

Sampling distributions for ten tests for comparing population variances in a two group design were generated for several combinations of equal and unequal sample sizes, population means, and group variances when distributional forms differed. The ten procedures included: (1) O'Brien's (OB); (2) O'Brien's with adjusted degrees of freedom; (3)…

By means of computer simulation of test responses, the reliability of item analysis data and the accuracy of equating were examined for hypothetical samples of 250, 500, 1000, and 2000 subjects for two tests with 20 equating items plus 60 additional items on the same scale. Birnbaum's three-parameter logistic model was used for the simulation. The…