Adaptive comparative judgment (ACJ) has been widely used to evaluate classroom artifacts with reliability and validity. In the ACJ experience we examined, students were provided a pair of images related to backpack design. For each pair, students were required to select which image could help them ideate better. Then, they were prompted to provide…

Designing experiential learning activities requires an instructor to think about learning outcomes. Using importance-performance analysis (IPA) can assist with the instructional design of the activities for implementing service-learning in distance education courses. This study used IPA in a fully online asynchronous graduate class to gauge…

The chapter explores critical roles of internal evaluators in contemporary organizational settings. The need is highlighted for an expanded, reconfigured, unorthodox set of roles and styles of work to meet the needs of the emerging learning organizations effectively. A discussion of major categories of internal evaluator roles emerged from the…

Techniques developed in a federal agency to forge links between evaluators and decision makers using evaluation information are described. Focus is on engaging the decision maker in the identification of candidate programs, selection among candidates, program evaluation, reporting of evaluation results, and assessment of evaluation impact. (SLD)

The sum-difference theory of remembering and knowing (STREAK) provides a sophisticated account of many interactions in the remember-know (R-K) area (C. M. Rotello, N. A. Macmillan, & J. A. Reeder, 2004; see record 2004-15929-002). It assumes 2 orthogonal strength dimensions and oblique criterion planes. Another dual-process model (J. T. Wixted…

This case study of one middle school focuses on improving teachers' skills in data-driven decision making through analysis of student work and their own professional practice. The expectation that schools will make adequate yearly progress has pushed evaluation practice down to the teacher level, where teachers are asked to analyze and…

The model presented forces us to view evaluation from two interdependent perspectives: conceptual and operational. Conceptual processes consist of planning, implementation, measurement, and decision making; operational processes consist of specifying, measuring and comparing objectives against a standard. (Available from: Grantsmanship Center,…

The nature and role of criteria in evaluation of adult education programs are presented in this study. The first half of the paper discusses several premises: The goal of evaluation is to use program judgments in the program decision making process. Criteria are essential to judgment and determining the type of criteria that is relevant is an…

Despite the critical importance of maintaining a valid and transparent selection process that serves the values held by all stakeholders involved in medical education (i.e., students, faculty, society), there continue to be problems with the current state of available admissions protocols. Some problems derive from inertia induced by inaccurate…

Whether judgments made by complete strangers as to the intelligence of subjects are accurate or merely illusory was studied in Germany. Target subjects were 50 female and 50 male adults recruited through a newspaper article. Eighteen judges, who did not know the subjects, were recruited from a university community. Videorecordings of the subjects,…

Moral development is viewed as a matter of progression in the cognitive reasoning and rationale underlying choices and judgments. Traditionally, retrospective reports of rationales have been used to measure moral development levels, resulting in unreliable information. Information Integration Theory attempts to assess individual differences in…

Summative evaluation is the final stage of the evaluation framework developed by the Center for the Study of Evaluation. Evaluation is a decision-oriented activity. The four-stage evaluation framework consists of needs assessment, program planning, formative and summative evaluation. The handbook presents exercises in summative evaluation. The…

This investigation employed an in-basket simulation to assess the effect of provisional analysis on the use of evaluation data by program administrators in making program decisions. Sixty-five volunteers from graduate education courses and 52 volunteers from undergraduate educational psychology classes at Western Kentucky University were randomly…

This book shows how to use evaluation to find effective solutions. The first two chapters introduce evaluation as an administrative function at the school level. Chapter 1 draws on two kinds of literature--educational-administration literature (to survey administrative practices) and educational-evaluation literature (evaluation practiced by…

College debaters who go to law school are often surprised by the differences between the processes that take place in the court of reason and the process that takes place in the court of law. The court of reason relies mainly on authoritative testimony, while the court of law relies on direct evidence. Evidence in the court of reason is either…