Judgmental standard setting methods, such as the Angoff method (W. Angoff, 1971), use item performance estimates as the basis for determining the minimum passing score (MPS). Therefore the accuracy of these item performance estimates is crucial to the validity of the resulting MPS. Recent researchers (L. Shepard, 1994; J. Impara, 1997) have called…

This study compares the results obtained using the Angoff, borderline group, and contrasting groups methods of determining performance standards. Congruent results were obtained from the Angoff and contrasting groups methods for several test forms. Borderline group standards were not similar to standards obtained with other methods. (Author/PN)

To set a standard on the "beardedness" test (see TM 507 062) the probability that a student with a specific score will be judged as bearded must be estimated for each test score. To get an unbiased estimate of that probability, a representative sample of students at each test score level must be chosen. (BW)

Livingston's (TM 507 218) response to Rowley (TM 507 062) is compared with the original Zieky and Livingston formulation of the Contrasting Groups Method of setting standards. (BW)

Influences on the educational validity of examinations are reviewed. Changes occurring in approaches to standard setting are traced. A view of reliability is presented, with emphasis on assessment of project work, which often involves individual investigation and design by students. A consistency index formula for grading standards is presented.…

A solution is offered to problems associated with the inequality in the manipulability of probabilities of classification errors of masters versus nonmasters, based on competency test results. Eschewing the typical arbitrary establishment of observed-score standards below 100 percent, the solution incorporates a self-correction of wrong answers.…

Notes that the methods used to set standards for National Assessment of Education Progress (NAEP) tests suggest recommendations for state-level policymakers. Explains the national assessment, basic assumptions in setting performance standards on NAEP, selection of judges, standard-setting methodology for NAEP, and measurement issues in setting…

The relations between Angoff ratings (minimum passing levels) and the actual "p" values for borderline examinees were studied with 115 examinees taking the Certified Financial Planner examination. Findings do not suggest that the Angoff judges' task is nearly impossible, but they do suggest the need to improve standard-setting…

Addresses what standards for English teachers should be and how they should work. Questions the value of the standards movement as it is playing out in the United States, especially as a vehicle for school reform. Suggests ways of positioning standards within a different rhetoric. (RS)

The process used to identify the provisional locations of points that would inform the National Assessment Governing Board in setting achievement levels for the science National Assessment of Educational Progress (NAEP) is described. This process includes identification of panelists for achievement-level setting and the method for converting…

This article considers the methods and difficulties of establishing, sharing and applying assessment standards within module teams working in a business school. Against a background of increasing reliance on explicit knowledge to establish standards in the HE sector the study looks at ways in which staff within module teams attempted to reach a…

Studies generally undergo an evaluation process before they are accepted for publication in an academic journal, presented at a conference, or released by a think tank. This article discusses the release of unreviewed research that sparks debate over the need for tighter peer-review mechanisms. Researchers from two of the nation's most eminent…

Congress should pay for the development of a national teacher test, using performance to judge accomplishment, and the test results should be incorporated into state licensing requirements, a report released May 24 argues. Prepared by a panel of the National Academy of Education, the 112-page guide calls on federal and state policymakers to…

This paper presents the assessment and item specifications for the National Assessment of Educational Progress (NAEP) 2009 mathematics assessment. "Chapter Two" contains descriptions of the five major content areas of mathematics (Number Properties and Operations, Measurement, Geometry, Data Analysis, Statistics, and Probability, and…

This issue brief outlines the immediate need for more accurate dropout and graduation data, while providing a snapshot of work currently underway. By drawing on two prominent methods for calculating graduation rates: the National Governors Association's endorsed longitudinal approach and the Averaged Freshman Graduation Rate (AFGR), this brief…