A statistical definition of information utilization for policy making decisions and an evaluation impact test to determine its occurrence are proposed. A univariate time series analysis is used to identify the internal trend for a given policy output variable and to control its effect. Two problems are identified in implementing an evaluation…

As California has struggled through economic and policy shifts, the "Teaching and California's Future" initiative has worked to highlight the strengths and weaknesses of the system of teacher development in the state and to provide policymakers with the data they seek to inform their decisions in strengthening schools. During the 2002-03…

Purpose: The association between certified nurse aide, licensed practical nurse, and registered nurse turnover and the organizational characteristics of nursing homes are examined. Design and Methods: Hypotheses for eight organizational characteristics are examined (staffing levels, top management turnover, resident case mix, facility quality,…

Although sampling has been mentioned as part of the chance and data component of the mathematics curriculum since about 1990, little research attention has been aimed specifically at school students' understanding of this descriptive area. This study considers the initial understanding of bias in sampling by 639 students in grades 3, 5, 7, and 9.…

Scientific research that is conducted without the structure of a supporting scientific paradigm should be labeled pseudoscience in that such research is deceptive or false science. It is argued that much of the research in educational technology is pseudoscience, with the focus on learner control research. Learner control is the design feature of…

In an investigation of item bias, the stability of Mantel-Haenszel (MH) estimates across different samples of test takers and different sample sizes and the robustness of the MH procedure with respect to item context effects were investigated. Data from the Second International Mathematics Study (1985) were analyzed. The data consisted of…

The statistical properties of two methods of estimating gain scores for groups in quasi-experiments are compared: (1) gains in scores standardized separately for each group; and (2) analysis of covariance with estimated true pretest scores. The fan spread hypothesis is assumed for groups but not necessarily assumed for members of the groups.…

This technical report presents results of an analysis of unit response rates for the components of the 1993-94 Schools and Staffing Surveys (SASS). The study was motivated by the general need to evaluate and improve the quality of SASS data and to identify potential sources of nonsampling error associated with nonresponse in SASS. As background,…

Two data collection designs, counterbalanced and spiraling (Angoff's Design I and Angoff's Design II) were compared using item response theory and equipercentile equating methodology in the vertical equating of 2 mathematics achievement tests using 1,000 eleventh graders and 1,000 twelfth graders. The greater stability of Design II is discussed.…

The reliability of Mantel-Haenszel (MH) indexes across samples of examinees and sample sizes and their robustness to item context effects were investigated with data for 670 African-American and 5,015 white students from the Second International Mathematics Study. MH procedures can be used to detect differential item functioning. (SLD)

The National Education Longitudinal Study of 1988 (NELS:88) serves as an example of how three specific problems of representativeness in a longitudinal study may be approached and overcome. NELS:88 was designed to provide longitudinal data about the educational transitions experienced by students as they leave eighth grade and move through high…

This brief report summarizes the results of a survey of professors of educational administration in the southern region of the United States, which sought to determine whether preparation programs were democratically administered. The survey included some demographic questions, 12 questions that asked respondents to rank preparation programs…

The National Household Education Survey (NHES) is a random digit dial telephone survey of households developed by the National Center for Education Statistics. It has been conducted in 1991, 1993, 1995, and 1996, with varying components each year. The NHES 91/93/95/96 CD-ROM contains an electronic codebook (ECB) program that, after being installed…

The National Reporting System (NRS) established reporting requirements for the adult education program required by Title II of the Workforce Investment Act. The NRS defines the measures local programs must collect, the methodologies for collecting them, and state reporting requirements. This document presents the guidelines for conducting the NRS…

Despite their claim to the contrary, Walsh and Carballo in their report, "Transitional Bilingual Education in Massachusetts: A Preliminary Study of Its Effectiveness" (1986), did not demonstrate the superiority of bilingual education because their study was marred by a number of problems, here identified. (BJV)