Discusses difficult aspects of the evaluation of student publications, in which the judge's analysis is often pitted against the adviser's aspirations for praise. (SR)

Maintains that scholastic press associations must listen to their advisers, students, and judges to make sure the evaluation service is meeting needs. (SR)

Notes that, although consultation researchers and practitioners have called attention to need for more psychometrically sound instruments, little advancement has occurred in this area. Outlines key quantitative and qualitative psychometric standards for organizational consultation assessment and evaluation instruments. Presents framework and…

Responds to article by Horan, Hanish, Keen, Saberi, and Hird (1993) criticizing Howard and Curtin's (1993) study of productivity and impact in counseling psychology and offering different version of productivity study. Contends that Horan et al.'s questioning of Howard and Curtin's methodological decisions is unfounded and at variance with facts…

Examines some issues raised in Gavin and Wamboldt's (1992) recent study on Family-of-Origin Scale (FOS). Discusses unresolved concerns regarding validity and utility of FOS and unsubstantiated and potentially misleading claims made by Gavin and Wamboldt. Makes case for conceptual and methodological precision in study of family phenomena.…

Describes factors that may bias psychoeducational decision making and discusses three heuristic principles that affect decision making. Discusses means by which school psychologists can be made aware of these heuristic principles and encouraged to consider them when making psychoeducational decisions. Also discusses methods by which bias in…

Question dimensions, construction, and response formats of 50 reactionnaire forms completed by participants in medical school programs were analyzed. Numerous problems in 30 forms and shortcomings in 20 others were identified. Ways to improve layout, appearance, anonymity protection, and questions were suggested. (Contains 53 references.) (SK)

Discusses contemporary controversies in evaluation that are likely to be of continuing importance in the near future, Including: (1) the nature and role of substantive theory in evaluation; (2) the importance of advances in methods; and (3) the meaning of "success as a profession." Asserts the necessity of positioning evaluation as part of…

Describes and critiques medical school rankings by "U.S. News & World Report" on methodologic and conceptual grounds, arguing that the annual evaluation falls short in both areas. Presents three alternative categories of program quality indicators. Concludes that the rankings have no practical value and fail to meet standards of…

This brief describes estimation and measurement issues relevant to estimating the quality of instruction in the context of a cumulative model of learning. It also discusses implications for the use of value-added estimates in personnel and compensation matters. The discussion highlights the importance of accounting for student differences and the…

This support document accompanies the NCVER report, "A Review of Indigenous Employment Programs," hereafter the "Report" [ED499667]. It contains explanatory notes on evaluation methodology, plus additional details on developments in labor market assistance and reviews of the literature relating to the evaluation of such…

The constraints of conducting evaluations in real-world settings often necessitate the implementation of less than ideal designs. Unfortunately, the standard method for estimating the precision of a result (i.e., confidence intervals [CI]) cannot be used for evaluative conclusions that are derived from multiple indicators, measures, and data…

Authentic assessment is a growing alternative to conventional testing. This research-to-practice article describes a framework for implementing authentic assessment. The R-E-A-L framework shows how roles, equipment, assessment tools, and location can be incorporated into early childhood practices.

On a general level, the objective of diagnostic classifications models (DCMs) lies in a classification of individuals regarding multiple latent skills. In this article, the authors show that this objective can be achieved by multidimensional adaptive testing (MAT) as well. The authors discuss whether or not the restricted applicability of DCMs can…

This paper is a polemical discussion of assessment in teacher education. Working from the proposition that assessment serves a number of important purposes for a range of stakeholders (students, employers, quality assurance agencies, government), it argues that there is considerable potential for conflict between the different purposes. In an age…