Career development practitioners understand that the value of career and employment services extends beyond attachment to the labor market. However, "soft" outcomes such as increased self-efficacy and improved ability to manage transitions are difficult to measure. Convincing funders and policy makers of the significance of such outcomes…

This article reviews issues involved with using norm-referenced measures within an intervention validity model. Methodological examination of intervention validity has become more important as intervention methodologies have become part of federal legislation. However, current practice and federal guidelines often implicitly portray a dichotomy…

This paper describes three multigrade school reforms in Latin America: (1) Colombia's "Escuela Nueva", (2) Guatemala's "Nueva Escuela Unitaria", and (3) Chile's MECE-Rural. Each reform endowed primary teachers and students with special training and instructional materials, and encouraged new kinds of instruction in rural…

What is the nature of latent predictors that facilitate diagnostic classification? Rupp and Templin (this issue) suggest that these predictors should be multidimensional, categorical variables that can be combined in various ways. Diagnostic Classification Models (DCM) typically use multiple categorical predictors to classify respondents into…

This article explores the statistical methodologies used in demonstration and effectiveness studies when the treatments are applied across multiple settings. The importance of evaluating and how to evaluate these types of studies are discussed. As an alternative to standard methodology, the authors of this article offer an empirical binomial…

The new "Weighted Student Formula Yearbook 2009" from the Reason Foundation provides a simple framework for touting the successes of states and urban school districts that grant greater fiscal autonomy to schools. The report defines the Weighted Student Formula (WSF) reform extremely broadly, presenting a variety of reforms under the WSF umbrella.…

This article considers potential impediments to the estimation of teacher quality caused primarily by the purposeful behavior of families, administrators, and teachers. The discussion highlights the benefits of accounting for student and school differences through a value-added modeling approach that incorporates a student's history of family,…

Values and beliefs underlying assumptions concerning the independent evaluations of persons and programs involved in the educational process are discussed. Particular emphasis is placed on M. Scriven's treatise on bias in evaluation (1976). Works by E. R. House, R. E. Stake, L. Stenhouse, M. Parlett and D. Hamilton, and D. L. Stufflebeam are also…

The assessment that occurs each day in the science classroom is often overlooked amidst calls for accountability in education and renewed debates about external testing. Research points to the positive influence that improved, ongoing classroom assessment can have on learning. Documents that offer visions for science education such as the National…

Explores heterosexist bias in seven widely used assessment instruments. Focuses on bias that is observable in the instruments themselves and in the ancillary materials. Describes three types of bias, how these biases manifest in various instruments, and makes recommendations for mental health practitioners and for professionals who develop…

Comments on an article that explored heterosexist bias in seven widely used assessment instruments. Raises concerns about how the article defined homophobia and heterosexism, and advocates a cautious approach to decreasing heterosexist and homophobic bias in assessment, which includes gathering assessment data. (RJM)

Outlines a scenario in which an evaluator wants to ask questions of teenagers that may pose ethical problems, or may be perceived as posing such problems. The hypothetical situation is the evaluation of a life skills program aimed at reducing the teen birth rate. (SLD)

Examined the indicators used in higher education performance reports from 29 states. Detailed findings include that in terms of readability, connection to academic departments, and relevance to various groups, the reports and indicators need improvement. Includes a list of the indicators used. (EV)

To test model of general managerial effectiveness, superiors (N=271), subordinates (N=605), and peers (N=469) rated 344 managers. Study designed to test three specific hypotheses on criterion type and criterion weights found consensus in effectiveness models of superiors, subordinates, and peers. Consensus among different raters was high on both…

The author suggests combining grades from component assessments to provide an overall student assessment. He explores the concept of reliability and concludes that the overall assessment will be reliable only if the number of grades used to report component achievements equals or exceeds the number used to report overall achievement. (Author/CH)