Conducted studies using two perspectives for obtaining evidence relevant to validity of autobiographical data. In Study 1, construct validity of standard psychological constructs (assertiveness, trustworthiness) obtained from autobiographies was equal to that of standard instruments designed to assess these constructs. Evidence for validity of…

Counterfactuals are routinely used in physical and biological sciences to develop and evaluate sophisticated, non-linear models. They have been used with telling effect in the study of economic history and American politics. For some historians, counterfactual arguments have no scholarly standing. They consider them flights of fancy, fun over a…

In response to a Congressional request, the General Accounting Office (GAO) investigated drug use measurement by reporting the drug use patterns of targeted groups in three nationally prominent drug studies, assessing the methodological strengths and limitations of the studies, and developing recommendations for the improvement of drug prevalence…

The impact of various definitions of the term "policy" on the nature and outcomes of policy analysis is illustrated by noting a variety of definitions which are implied in the literature. These definitions are applied to exemplar policy arenas to note their differential effect. The policy arenas discussed include the community…

In German, this article asserts that present concepts of evaluation are too narrow for curriculum evaluation. Research must differentiate different forms and roles of evaluation, produce a curriculum evaluation model, and resolve problems of values and judgement. The second section discusses the different forms and roles of evaluation: formative…

The importance of addressing the political dynamics inherent in any evaluation research process is discussed. The theoretical orientation contributing to the denial and avoidance of politics is articulated and contrasted with one which posits politics as normative and useful. (Author/LMO)

This article reviews the agricultural research evaluation literature in an effort to assess the extent of coverage in this area. Coverage breakdowns with respect to evaluation approaches, types of research, and products and production processes are presented. Results suggest that there has been limited coverage of research undertaken in…

Construct validation theory is founded upon conflicting metaphysical principles, methodological approaches, and standards of adequacy. This paper explores these unrecognized conflicts and indicates some consequences that these conflicts have for construct validation theory. (Author/PN)

The purposes of this article are, first, to argue that analyses based on level of treatment implementation can lead to biased estimates of treatment effects, and second, to discuss alternatives to this approach. (PN)

External and implementation factors and their potential threats to field test validity and the practical realities of the field testing process on results are discussed. External factors include site selection, negotiations, contracts, site monitoring, training, and type of product. Implementation factors include motivation, dependence on local…

Addresses the current breach between qualitative and quantitative methods for evaluation. Develops an argument for the continuity of qualitative and quantitative methods. (Author/MLF)

Sixteen listeners (10 expert, 6 naive) judged the dissimilarity of pairs of voices drawn from pathological and normal populations. Only parameters that showed substantial variability were perceptually salient across listeners. Results suggest that traditional means of assessing listener reliability in voice perception tasks may not be appropriate.…

Used statistical procedures that have become routine in other social sciences to analyze data from clinical service records. Despite absence of control groups, nonrandom assignment of clients to treatment conditions, and incomplete records, effective analyses of psychotherapeutic process were possible. Graphical methods for summarizing large data…

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

A conceptualization of generalization and its place in educational research is proposed. Problems with existing approaches to generalization include limited concepts, misleading or simplistic results, perception variance or change, and the discouragement of sensitivity due to convenience. Researchers should distinguish between conclusions which…