This project began with the delineation of the roles and functions of respiratory therapy personnel by the American Association for Respiratory Therapy. In Phase II, The Psychological Corporation used this delineation to develop six proficiency examinations, three at each of two levels. One exam at each level was designated for the purpose of the…

During round 16 of the National Longitudinal Survey of Youth (NLSY), 900 NLSY sample members were randomly assigned to be interviewed about the period since their round 14 interview. Their responses were compared to those of approximately 8,000 NLSY sample members who were assigned to be interviewed about the 1-year period since their round 15…

For six tests, coefficient delta as an index for internal optimality is computed. Internal optimality is defined as the magnitude of risk of the decision procedure with respect to the true score. Results are compared with an alternative index (coefficient kappa) for assessing the consistency of decisions. (Author/JKS)

The path coefficients in an explanatory model of teaching and learning were corrected for error of measurement using generalizability theory. The disattenuation procedure effectively clarified and increased the interpretability of results. (Author/CTM)

Results of the Vocabulary, Reading Comprehension, and Mathematics Concepts subtests of the Iowa Tests of Basic Skills were analyzed for sex bias. On the whole, little evidence for sex bias was found for the four subtests and three grade levels examined. (Author)

Combines item response theory (IRT) and statistical methods to analyze California Achievement Test-Mathematics (CAT-M) results for 4,135 seventh graders in northeast Ohio. Provides information to educational analysts about which IRT model fits CAT-M data for the target population, test accuracy in estimating students' abilities at different…

This study examined stability and reliability of free-living physical activity assessed by pedometer in 69 young female college students (M age = 18.7 years, SD = 1.2, range: 18-25 years; body mass index = 23.2 kg/m[superscript 2], SD = 0.6) for two complete weeks (Week 1 and Week 2) separated by 12 weeks. During Week 1, participants took an…

This study set out to empirically determine the reliability and validity of the Vocabulary Levels Tests, both the passive and productive versions. Furthermore, attempt was made to investigate the nature of the students' vocabulary knowledge with regard to their passive and active knowledge of the L2 words as a whole and at different word frequency…

The research literature provides important guidance to counselors working to keep abreast of the latest thinking regarding best practices and recently developed counseling tools. The purpose of this digest is to highlight a few errors that seem to recur within the literature, and to provide some helpful references that further explore these…

Procedures used in Doctor of Education (Ed.D.) dissertations at the University of Alabama (Tuscaloosa) were studied. Focus was on identifying: (1) characteristics of the research designs used; (2) sources of the instruments used to collect data; (3) reports of reliability estimates and evidence of validity of the instruments; and (4) types of…

The Walsh and Carballo evaluation of the effectiveness of transitional bilingual education programs in five Massachusetts communities, has the following flaws: (1) the sample of school districts studied suffered from "self-selection bias"; (2) the sample does not include a single large, urban school district; (3) the student samples…

A study investigated the alternate forms reliability of the Armed Services Vocational Aptitude Battery (ASVAB) Forms 8, 9, 10, and 11. Usable data were obtained from 62,938 armed services applicants who took the ASVAB in January and February 1983. Results showed that the parallel forms reliability coefficients between ASVAB Form 8a and the…

The use of meta-analysis in industrial and organizational psychology has become quite common. Unfortunately, the understanding and research necessary to ensure appropriate application of the technique have not been as widespread. As part of a larger study, a content analysis of meta-analyses from the industrial and organizational psychological…

This document contains three papers from the Methodology Project of the Center for the Study of Evaluation. Methods for characterizing test accuracy are reported in the first two papers. "Bounds on the K Out of N Reliability of a Test, and an Exact Test for Hierarchically Related Items" describes and illustrates how an extension of a…