This article illustrates the synergistic role between practice and theory in evaluation. Using reflective practice, the author reviews her own work as well as the work of other evaluators to illustrate how theory can influence practice and, in turn, how evaluation practice can inform and grow theory, especially evaluation theory. The following…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…

Treatment integrity (also referred to as "treatment fidelity," "intervention integrity," and "procedural reliability") is an important methodological concerning both research and practice because treatment integrity data are essential to making valid conclusions regarding treatment outcomes. Despite its relationship to validity, treatment…

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

Background/Context: Although the importance of facilitating transfer from community colleges to 4-year institutions is almost universally accepted, there is little consensus on how to measure transfer success or evaluate policies aimed at assisting students in making this educational transition. Despite the increasing attention on transfer in…

Discusses the history of evaluation research, focusing on current emphasis on "evidence-based policy." Highlights five issues emerging as relevant: evaluation can be done in many ways, serious doubts exist about the usefulness of the term "evaluation," evaluation is held back by paradigm wars, views of evaluation are…

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

The concept of treatment integrity cuts across a diversity of fields involved with providing treatments or interventions to individuals. In medical treatments, the concept of "treatment compliance" or "treatment adherence" is an important and problematic issue. In the field of nutrition, the concept of "dietary adherence" is important for…

Multiple sources of influence impact the decisions about what and how teacher educators are expected to operate, including the innovations that are adopted. Some of those sources of influence (such as teacher certification boards) can demand that certain curricula be adopted, specific instructional procedures be utilized, and delineate the…

The lack of consensus among researchers in defining the focal construct of rurality has led to contradictory conclusions of whether or not a rural-urban performance gap exists in higher education. Compounding this problem are the changing definitions of rural and urban, even among governmental agencies. Thus, this study used two different…

Quality has become a priority issue for all concerned with early childhood care and education services. Starting from the premise that quality is a relative and dynamic concept based on values and beliefs, this collection advocates that the process of establishing definitions of quality should involve a range of stakeholder groups. The chapters…

This book, which is intended for adult educators and human resource developers, presents guidelines for assessing adult learning. The following are among the topics covered in the book's eight chapters: (1) basic principles of informal assessment (relationship between learning and assessment activities; sequencing learning and assessment…