This paper reports 20 unsolved problems in educational measurement and points toward what seem to be promising avenues of solution. The first group of concerns involves validity, posing the problems of obtaining suitable validity criteria, determining and measuring the predictor variables that best characterize the traits and proficiencies of…

A study was conducted to provide information for setting two separate standards, the accuracy score and the documentation score, for the Praxis III: Classroom Performance Assessment (Praxis III). Praxis III is intended for making instructional and licensing decisions about beginning teachers. This standard-setting study was a person-judgment…

What should students learn in school, and how well must they learn it? This question is the subject of intense discussion as states around the nation begin establishing high standards for student performance. In many states, educators and policymakers are turning to the business community for input on developing standards. This guide offers…

The New Standards Project is a partnership of 17 states and 6 major school districts that have joined to develop alternative approaches to setting educational standards and assessing student achievement. In the New Standards Project plan, formal standard setting occurs through a process of public examination of student work products on pilot…

The vision of the Goals 2000 program for educational improvement leads to the fundamental question of what we want students to know. School districts throughout the country are beginning to grapple with this question, and some national efforts have been made to help them. The National Council on Education Standards and Testing has recommended…

This report discusses a House of Representatives bill (H.R. 2435) to establish a National Council on Education Standards and Testing. The bill's title and purpose, and the congressional findings behind it are outlined first, followed by a summary of provisions concerning the Council's establishment, duties, reports, membership, director and staff,…

The problem of setting standards has always been an issue in the educational community. This paper offers an outline of one state's procedure for setting a passing score for a competency-based test in mathematics. The Maryland Functional Mathematics Test (MFMT) becomes a graduation prerequisite for the graduating class of 1987. The procedures used…

Evidence of the validity of the National Teacher Examinations' (NTEs') Early Childhood Education Test (ECET) as it is used in the New York City School System is presented. The NTE Core Battery and Specialty Area Tests are used as part of the alternative process for teacher licensure in New York City. The ECET measures knowledge and skills required…

Standards, passing scores, or cut scores have been seen as an element of criterion-referenced tests since their introduction. This paper discusses at least two issues surrounding the establishment of cut scores which appear to need clarification: (1) the theoretical definition of a cut score; and (2) decisions which must be made in selecting a…

A study of the processes for establishing the principles and policies of measurement and disclosure in preparing financial reports examines differences in these processes in the United States, Canada, and England. Information was drawn from international accounting literature on standard setting. The differences and similarities in the…

A scoring rubric transition study is described. It was designed to evaluate possible drift in scoring the Maryland Writing Test from year to year (when using a modified holistic scoring method), to evaluate strategies for revising swing rubrics from narrative and explanatory writing while maintaining original scoring standards, and to establish…

The validity of combining a correction for guessing with the Nedelsky-based cutscore was investigated. A five option multiple choice Mathematics Achievement Test was used in the study. Items were selected to meet several criteria. These included: the capability of measuring mathematics concepts related to performance in introductory statistics;…

This manual is written for the individual responsible for choosing the passing score on an educational or occupational test. It concentrates on practical advice to help select and apply a method for choosing the passing score. Decisions, standards, and judgments are defined and discussed in terms of considerations in choosing a passing score…

A latent trait method is presented to investigate the possibility that Angoff or Nedelsky judges specify inconsistent probabilities in standard setting techniques for objectives-based instructional programs. It is suggested that judges frequently specify a low probability of success for an easy item but a large probability for a hard item. The…

Seven guidelines for setting minimum competency standards for high school graduation are presented: (1) Competency standards for the diploma should be developed by a process that gives major attention to the needs of students yet recognizes an institutions's responsibility to societal needs. (2) Competency standards should be developed using good…