In order to evaluate standard setting procedures, apart from the more commonly applied approach of simply comparing the derived standards or failure rates across various techniques, this study investigated the errors of classification associated with the contrasting groups procedures. Monte Carlo simulations were employed to produce…

This book articulates a process by which schools and districts can design their own standards-based system of education and provides models for implementing standards-based education. Chapter 1 describes the history of and impetus for the standards movement. Chapter 2 addresses such issues as: Where will the standards come from? What type of…

A new standard setting approach is introduced, called the cognitive components approach. Like the Angoff method, the cognitive components method generates minimum pass levels (MPLs) for each item. In both approaches, the item MPLs are summed for each judge, then averaged across judges to yield the standard. In the cognitive components approach,…

Issues concerning the selection of judges for standard setting are discussed. Determining the consistency of judges' recommendations, or their congruity with other expert recommendations, would help in selection. Enough judges must be chosen to allow estimation of recommendations by an entire population of judges. (SLD)

This paper reports on a newly designed judgmental method for setting test performance standard that: (1) overcome many of the practical and psychometric problems associated with the Angoff and Ebel methods; (2) can be used to set multiple cut points on a score scale; (3) may be readily and efficiently implemented with assessments that use…

Understanding the behavior of those evaluating a speech is important for a complete understanding of the public communication process. Ratings of public speaking were submitted to a Rasch analysis to determine whether objective measurement can create and maintain a standard of speech evaluation. Data used were 1,022 ratings of 168 speeches given…

This study evaluated procedures for establishing a minimum performance standard for the essay subtest of the National Teacher Examinations Communications Skills test. Results indicated the preferred procedure for setting standards on essays should involve a blind review followed by an informed review. (Author/DWH)

Issues related to the establishment of formal standards for student achievement on large-scale assessments are discussed, and two approaches to standard setting that have been used in Saskatchewan (Canada) are described. In spite of the general success of these programs, numerous issues to consider in future evaluations are raised. (SLD)

It is now a matter of routine that schools in England are able to demonstrate the value of their work in terms of "impact" and "outcomes." In the province of imaginative education this is problematic. While Government has sought to create a new relationship between inspection and school self-evaluation, this in effect has…

Seven guidelines for setting minimum competency standards for high school graduation are presented: (1) Competency standards for the diploma should be developed by a process that gives major attention to the needs of students yet recognizes an institutions's responsibility to societal needs. (2) Competency standards should be developed using good…

This report describes an effort to enhance the effectiveness of teacher educators. The endeavor, which is in its early stages, is a work-in-progress initiated by the Association of Teacher Educators (ATE). The goals of the initiative are to reach consensus on standards for teacher educators; develop rigorous, fair, and feasible assessments related…

The cognitive components standard setting method, recently introduced by D. McGinty and J. Neel (1996), asks judges to specify minimum levels of performance not for the test items, but for smaller portions of items, the component skills and concepts required to answer each item correctly. Items are decomposed into these components before judges…

The extent to which the Joint Committee "Standards" for evaluation might be used to develop culturally relevant standards for use in other countries and how they might be modified for use in cross-cultural settings were explored using Malta and India as examples. Substantial modifications are probably necessary. (SLD)

Whether common standards exist among the national standards for kindergarten through grade 12 mathematics, science, and civics and government was studied. Common standards were explored among "Curriculum and Evaluation Standards for School Mathematics," produced by the National Council of Teachers of Mathematics, the "National…

Investigates the evaluation processes used in preschools, focusing on such issues as the extent to which (1) teachers use standards to support their evaluations; (2) whether standards teachers use are congruent with those that research and theory suggest would be used by preschool children; and (3) the extent to which teachers make causal…