In "Holding Accountability to Account: How Scholarship and Experience in Other Fields Inform Exploration of Performance Incentives in Education"--a paper presented at the National Center on Performance Incentives research to policy conference in February--Richard Rothstein, a research associate at the Economic Policy Institute, argues educational…

Program impact methodology--usually referred to as evaluation research--is described as it is developing in the United States. Several problems face the field of evaluation research. First, those issues grouped as "meta-scientific" include: (1) the distinction between qualitative and quantitative studies; (2) the separation of implementation and…

A procedure is proposed for determining whether correlations obtained between two measures justify the assumption that the measures are identical. It is intended especially for small samples. In the example, the performance scales of two intelligence tests were administered to 32 deaf adolescents. (GDC)

Multiple regression analysis is discussed as useful for studying the effect of a variable while controlling for the effects of others and for estimating the total effect of all predictor variables together. It is suggested that in English-as-a-Second-Language proficiency measurement, regression coefficients should not be the basis for judging…

A test of statistical significance is a procedure for determining how likely a result is assuming a null hypothesis to be true with randomization and a sample of size n (the given size in the study). Randomization, which refers to random sampling and random assignment, is important because it ensures the independence of observations, but it does…

This paper acknowledges that research on school dropouts presents problems in the definitions and computation of dropout indices. It considers a variety of methods for computing dropout rates, using dropout rates which are real and which were available at the end of the 1986-1987 school year. Fall enrollment, average daily membership, and total…

Describes two research projects linking family processes with elementary school children's competence in school to provide examples of methodological issues related to investigations that cross systems of family and school. Issues discussed include gaining cooperation from school, recruitment and consent procedures, data collection and measurement…

Learning styles advocates claim long-term improvements in four aspects of teaching and learning: curriculum design, instructional methods, assessment, and student guidance. The application of learning style theory encompasses three pervasive problems: confusion in definitions, weakness in measurement reliability and validity, and identification of…

A new report published by the Buckeye Institute for Public Policy Solutions is a minor variant on six similar reports published by the Friedman Foundation over the past three years. The new report repeats some of the errors in the previous reports, and it follows a parallel structure, arguing that the costs of dropping out are dramatic for the…

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

The concept of treatment integrity cuts across a diversity of fields involved with providing treatments or interventions to individuals. In medical treatments, the concept of "treatment compliance" or "treatment adherence" is an important and problematic issue. In the field of nutrition, the concept of "dietary adherence" is important for…

The paper states that quantification is neither ethical nor unethical, but is ethically neutral. It is the behavior or intent of the human being that is clearly a matter of ethical concern. Like numerology and the sects of inumerates and qualitatives, there is not so much an unethical practice that is supported as there is a lack of vision and…

Huggins' report lacks serious data collection on college Black Studies Departments, omits the strongest ones, fails to record their history accurately, and does not assess the research achievements of its scholars. Huggins overlooks the importance of applying an Afro-centric perspective to phenomena related to people of African descent. (PS)

Methods of using simplified time series analysis (STSA) in evaluating clinical programs are discussed. STSA assists in addressing problems of attrition/augmentation of subjects in programs with changing populations. Combining individually calculated "C" statistics in a simple aggregate analysis of restraint usage by nursing home staff…

Why conclusions of many outcome evaluations do not stand up to scrutiny is discussed, drawing on examples from evaluations of drug abuse prevention programs. Factors that undermine these studies are largely the result of social-structural problems that influence the design and implementation of the research. (SLD)