A hallmark of the US education system is the opportunity afforded to students to pursue education and career paths of their own choosing. This flexibility and autonomy, however, has drawbacks. Students must navigate a series of complex and often disconnected environments, as well as numerous decision points, before they attain a fulfilling career.…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…

In this commentary, the author points out few issues, one being that there are models mislabeled as diagnostic, which deal with linear decompositions of item difficulties rather than estimating multidimensional skill variables. The author discusses the issue that there are many new names for essentially well-known models for multiple simultaneous…

As Rupp and Templin (2008) stated directly, diagnostic classification methods "are confirmatory in nature." Methods, though, are neither inherently confirmatory nor exploratory. Diagnostic classification modeling, with its analytical and computational obstacles eventually yielding as a comprehensive and potent discipline emerges, will…

The paper by Rupp and Templin (2008) is an excellent work on the characteristics and features of cognitive diagnostic models (CDM). In this article, the authors comment on some substantial and methodological aspects of this focus paper. They organize their comments by going through issues associated with the terms "cognitive,"…

Diagnostic assessment is currently an active research area in educational measurement. Literature related to diagnostic modeling has been in existence for several decades, but a great deal of research has been conducted within the last decade or so, especially within the last five years. The author summarizes the key components in the application…

Treatment integrity (also referred to as "treatment fidelity," "intervention integrity," and "procedural reliability") is an important methodological concerning both research and practice because treatment integrity data are essential to making valid conclusions regarding treatment outcomes. Despite its relationship to validity, treatment…

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

Serious issues in empowerment evaluation are articulated to help ensure that this enthusiastically presented concept will not mislead evaluators and result in lowering the field's professional standards. Analysis and recommendations are provided for the adoption, development, and implementation of an objectivist evaluation that conforms to…

Quality of life issues in social skills assessment of persons with disabilities are discussed in terms of definitions, measures, applications to social skills assessment, and future needs. It is argued that broader measures need to be used in social skills assessment in order to evaluate quality of life changes. (CR)

Background/Context: Although the importance of facilitating transfer from community colleges to 4-year institutions is almost universally accepted, there is little consensus on how to measure transfer success or evaluate policies aimed at assisting students in making this educational transition. Despite the increasing attention on transfer in…

Examines consequences of using alternative definitions for prevalence, sex ratio and heritability. Demonstrates that the characteristics of reading-disabled children vary with the way disability is defined. Concludes that the use of regression-based procedures for identifying reading disability is desirable. Suggests insufficient evidence exists…

Discusses the history of evaluation research, focusing on current emphasis on "evidence-based policy." Highlights five issues emerging as relevant: evaluation can be done in many ways, serious doubts exist about the usefulness of the term "evaluation," evaluation is held back by paradigm wars, views of evaluation are…

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

The concept of treatment integrity cuts across a diversity of fields involved with providing treatments or interventions to individuals. In medical treatments, the concept of "treatment compliance" or "treatment adherence" is an important and problematic issue. In the field of nutrition, the concept of "dietary adherence" is important for…