This digest describes some of the basic logic-of-evaluation skills and some of the basic methodological skills that need to be mastered in order to practice the art and science of evaluation. Some topics from the logic of evaluation that must be dealt with include understanding : (1) the differences and connections between evaluation and other…

An annotated bibliography is organized to match the format of the Standards for Evaluations of Educational Programs, Projects, and Materials, including sections on utility, feasibility, propriety, and accuracy of evaluations. It identifies literature that includes in-depth information about the issues covered in the Standards. The Standards are…

Meta-analysis is a collection of systematic techniques for resolving apparent contradictions in research findings. Meta-analysts translate results from different studies to a common metric and statistically explore the relations between study characteristics and findings. Since G. Glass first used the term "meta-analysis" in 1976, it has…

The research literature provides important guidance to counselors working to keep abreast of the latest thinking regarding best practices and recently developed counseling tools. The purpose of this digest is to highlight a few errors that seem to recur within the literature, and to provide some helpful references that further explore these…

This document consists of the first 10 articles of volume 8 of the electronic journal "Practical Assessment, Research & Evaluation" published in 2002-2003: (1) "Using Electronic Surveys: Advice from Survey Professionals" (David M. Shannon, Todd E. Johnson, Shelby Searcy, and Alan Lott); (2) "Four Assumptions of Multiple Regression That Researchers…

Studies on the criterion validity of student evaluation-of-instruction instruments are analyzed, and recommendations are offered for future research into student evaluation of instruction. The main problem, and probably the reason for the lack of validity studies, is that it is difficult to agree on what the criteria of effective teaching should…

This digest discusses the use of benchmarking as a strategy for assessing and improving efficiency and productivity of administrative processes and instructional models in colleges and universities. Benchmarking, developed by the Xerox Corporation in the 1980s, is defined as an ongoing, systematic process for measuring and comparing the work…

Over the last 15 years or so, research into measurement error has begun to consider not just whether the test items fit, but whether the people who answer the items fit. Attempts to systematically identify people who do not fit the typical pattern have led to several "person-fit statistics." This digest describes the need for such…

Directed at practitioners in adult and career education, this document defines qualitative research, compares qualitative research to quantitative research, describes the "war" between proponents of each kind of research, describes how to assess qualitative research, and explains how to choose and use qualitative techniques. Pitfalls of…

The review of science education research for 1982 includes analyses of 455 studies reported in dissertation abstracts, journal articles, research papers, and papers presented at conferences. The organization of the review is topical. Topic areas include: (1) student characteristics and behavior (cognitive development, conceptual understanding,…

Written for teachers who want introductions to conducting school assessments and to studying features of writing, this book is intended (1) to provide ways for teachers to analyze writing samples and the writing process for school or program assessment, and (2) to promote the development of teacher research among kindergarten through grade 12…

This document consists of papers published in the electronic journal "Practical Assessment, Research & Evaluation" during 2000-2001: (1) "Advantages of Hierarchical Linear Modeling" (Jason W. Osborne); (2) "Prediction in Multiple Regression" (Jason W. Osborne); (3) Scoring Rubrics: What, When, and How?"…

This report concerns the use of benchmarking as a strategy for assessing and improving efficiency and productivity of administrative processes and instructional models in colleges and universities. The introductory chapter addresses the need for new tools and strategies to meet the increased competition and the higher demand for accountability…

Some steps to identify an initial set of indicators and to develop alternative indicator systems are outlined for educational evaluation and illustrated through the example of a National Science Foundation (NSF) study of mathematics and science education. The first step is to conceptualize potential indicators to specify a comprehensive monitoring…

Noting that listening is a major concern of basic skills teachers, counselors, and employers, this annotated bibliography cites references for current behavioral research and methodology in teaching listening skills. Forty-nine references are included, as well as information on how to order those citations drawn from the ERIC database. (JC)