Evaluators need new strategies that will support their commitment to science and at the same time preserve the objectivity of the evaluation. The article discusses three strategies, dealing with: philosophical foundations, the subjectivity of the "objects" of the studies, and the subjectivity of the observer. (Author/GDC)

Trade-offs are implicit in choosing a subjective or objective method for evaluating social programs. The differences between Bayesian and traditional statistics, decision and cost-benefit analysis, and anthropological and traditional case systems illustrate trade-offs in choosing methods because of limited resources. (SLD)

The authors of this article contend that the Guinan and Foulds study was inadequately designed and executed, and the results indicate little of the "usefulness" of the test, much less illuminate the important hypothesis central to the investigation. Specific suggestions for further research in marathon group evaluation are made. (Author)

Analysis of the assumptions underlying the stakeholder approach to evaluation combined with the limited experience in testing the approach reported in this volume, suggests that some claims are cogent and others problematical. (Author)

Two methods for dividing an interrupted time-series study between baseline and experimental phases when study resources are limited are compared. In fixed designs, the baseline duration is predetermined. In flexible designs the baseline duration is contingent on remaining resources and the match of results to prior expectations of the evaluator.…

Contains seven articles discussing the application of meta-analysis to research on outcomes in psychotherapy. Provides a framework for understanding meta-analytic procedures and outlines major techniques. Reviews criticisms of integration of psychotherapy outcome research. Evaluates comparative therapy outcome research and discusses limitations of…

Describes the evolution of national educational assessment in the United States, its present stage of development, methodological and reporting problems, and approaches applicable to assessment data. Examines how proposed approaches can be applied in the California Assessment Program and in the National Assessment of Educational Progress. (MJL)

This review of two journal articles focuses on the tendency of many anthropologists to emphasize ideological concerns and activist orientations over respect for the truth. (Author/BE)

The measurement of psychological states requires an entirely different technology from the classical personality inventory assessments of psychological traits. Differences in the requirements of state v trait measurement are discussed. Problems of naming, labelling, describing, defining, and interpretation are discussed in relation to…

The methodological and practical problems that are especially common in or unique to assessment research in correctional settings are discussed. The distinctive culture of correctional institutions and the complications caused by governing bodies contribute to the particular problems encountered in collecting and analyzing data. (SLD)

Examines difficulties with citation analysis as it is used to study citation frequency, usually for the evaluation of scientists, publications, or institutions. Topics addressed include selection of a control set of papers, comparisons of different types of papers (e.g., methodological or theoretical), effects of independent variables, and use of…

Reviews the Family Privacy Protection Act of 1995 and its potential impact on research and evaluation involving minors. Although this legislation was not passed, the issues related to both active and passive parental consent for the participation of minors in research are very much alive. (SLD)

An introduction to profiles is presented with examples provided to permit an overall appraisal of the potential of profiles, of the principles upon which they might be based, and of the problems that will have to be overcome if their potential is to be realized in practice. The larger scale examples of profiles discussed are the Scottish Pupil…

This paper offers answers to nine important questions concerning standard-setting issues and methods: (1) Should normative or content-referenced standards be used? (2) Different standard-setting methods yield different results. What is your reaction to this finding? That of your clients? Does this finding present a problem for the application of…