This study was designed to investigate several scoring modalities in terms of the accuracy of scores and the efficiency of scoring procedures. Five scoring modalities (SM) are conceptualized by considering tasks and raters as sources of error where "p,""t," and "r" represent person, task, and rater, respectively.…

A survey was sent to members of the Evaluation Use Topical Interest Group (TIG) to determine their perceptions about and experiences with evaluation use. Responses from 282 members show agreement on the major purposes of evaluation and an increased use of performance-results oriented and formative evaluations. (SLD)

Presents specific examples of performance evaluation in a high school chemistry class. Offers suggestions for doing performance evaluations. (DKM)

Analyzes the three major inferences involved in interpretation of performance assessments: (1) scoring of the observed performances; (2) generalization to a domain of assessment performances like those included in the assessment; and (3) extrapolation to the large performance domain of interest. Suggests ways to improve the validity of performance…

Argues that selecting data according to expected information gain, as proposed by M. Oaksford and N. Chater (1994, 1996), leads to suboptimal performance in Bayesian hypothesis testing. Procedures are presented that are better justified normatively, their psychological implications are explored, and a number of novel predictions are derived under…

Argues that Klauer's proposal (1999) and proposal presented are equally well justified from a normative perspective and that, where the predictions of the two approaches diverge, the existing empirical evidence is consistent with the information gain approach. Recommends that more empirical research is required to decide between these two…

The concerns postmodernists have about evaluations, especially in education, are explored. Postmodernist and standards-based perspectives on evaluation are described, and specific questions about the role of postmodernism in evaluation are addressed from a standards-based perspective. (SLD)

Suggests that performance measurement data already being collected could become more useful, at low additional cost, by further analyzing the relationships among the measures, especially across time. Using logic models and analyzing variability among program delivery units could provide evidence for hypothesized connections among delivery,…

Explores the challenges of performance measurement in the context of political and resource pressures that frame the demand and supply of program evaluation. Professional evaluators must be resourceful and efficient in using their intellectual and persuasive powers to enlighten politicians and the public about program theory and effective…

Describes recent improvements in the Chicago Public Library's performance evaluation system that has made it more participative and effective. Discusses three areas of change: broadening the range and improving the relevance of the appraisal criteria; increasing the number of rating criteria; and requiring narrative commentaries on employee…

Describes the different types of scoring rubrics, explains why scoring rubrics are useful, and presents a process for developing scoring rubrics. Concludes with a description of resources that contain examples of the types of scoring rubrics and additional guidance for the scoring rubric development process. (SLD)

Suggest that the insistence on reporting in terms of performance standards in situations where they are not essential has been more harmful than helpful. Discusses variability in the definitions of proficient academic achievement by status for purposes of the No Child Left Behind Act of 2001. (SLD)

Assessment is an ever changing and challenging topic for teacher-librarians and teachers. Designing authentic assessment tools that help students know what is expected of them as well as providing options for unbiased evaluation are feats for even a master educator. This column focuses on Web sites that provide insight into the authentic…

Differential Item Functioning (DIF) occurs when there is a greater probability of solving an item based on group membership after controlling for ability. Following administration of a 50-item scientific and quantitative reasoning exam to 286 two-year and 1174 four-year students, items were evaluated for DIF. Two-year students performed…

This issue of ETS Policy Notes briefly summarizes the results of the Adult Education Program Survey (AEPS) sponsored by the U.S. Department of Education and conducted by ETS. The results provide a comprehensive picture of federally supported adult education activities in the United States. This picture includes a description of adult education…