Discusses the problems associated with "grading on a curve," the approach often used for standard setting on language proficiency tests. Proposes four main steps presented in the setting of a non-arbitrary cut-score. These steps not only establish a proficiency standard checked by external criteria, but also check to see that the test covers the…

This paper provides an overview of the methods and results of alignment analyses and standard-setting procedures used in investigations conducted during the development of alternate assessments in two states: Wisconsin and Idaho. To meet the assessment and accountability mandates contained in the Individuals With Disabilities Education Act…

The Associate Degree is a two year academic credential available with an Arts or Science focus. The British Columbia Council on Admissions and Transfer (BCCAT) initiated development of this provincial credential at the request of British Columbia's public post-secondary institutions. The original curricular requirements, the goal of which were to…

Transfer relationships in British Columbia (BC) are governed by statements which were adopted by the Council in 1993 after consultation with the institutions of the BC Transfer System. Principles and guidelines in this document are based on those formulated by the British Columbia Post-Secondary Coordinating Committee and approved by university…

This paper aims to provide a critical review and comparison of the following sets of standards of practice for teachers: (1) The Victorian Interim Teacher Class Standards (ITCS), especially Interim Teacher Class Standards for Beginning Teachers; (2) Professional Standards for Teachers; (3) The National Competencies for Beginning Teaching; (4) The…

This paper describes major concepts related to item analysis for criterion-referenced tests including validity, reliability, item difficulty, and item discrimination, particularly in relation to criterion-referenced tests. The paper discussed how these concepts can be used to revise and improve items and listed suggestions regarding general…

American business is caught in a painful paradox because, although there are many applicants for jobs, few have the skills employers require. The mismatch between skills required and skills available generates huge costs for industry. Some are clearly related to school-system underperformance, but others are less obviously related to lax…

Due to the high stakes that my be attached to placement decisions, it is imperative that the placement process be as solid and defensible as possible. An integral part of the placement process is the identification and use of cut scores, the point(s) on the score scale that classify students into adjacent categories for placement decisions. This…

A structured Delphi procedure was used to secure the informed judgments of three types of adult participants (n=170) on appropriate standards for the North Carolina High School Competency Tests in Reading and Mathematics. The feasibility of the method and the amount of agreement between groups are discussed. (Author/PN)

The use by 31 reading specialists, compensatory education teachers, and secondary reading teachers of Angoff and Nedelsky methods for setting cutting scores for a high-school graduation test in reading comprehension was studied. The Angoff method provides a wider variety of information and yields estimates closer to actual p values. (TJH)

The borderline group standard-setting method (BGSM), Nedelsky method (NM), and Angoff method (AM) were compared, using reading scores for 1,948 and mathematics scores for 2,191 sixth through ninth graders. The NM and AM were inconsistent with the BGSM. Passing scores were higher where students were more able. (SLD)

A framework is provided for examining the validity of performance standards for high-stakes achievement tests. Assumptions that need to be evaluated are that the passing score corresponds to specified performance standards and that the specified standard is reasonable given the purpose of the decision. (SLD)

Several methods for determining a passing score on an examination from individual raters' estimates of minimal pass levels were compared through simulation. The methods used differed in the weighting estimates for each item received in the aggregation process. Reasons why the simplest procedure is most preferred are discussed. (SLD)

An approach is presented to the definition of minimal competence for judges to use in standard setting. Panelists in standard setting must receive training to ensure that differences in rating result from differences in perceptions of item difficulty, not in differences of opinion about the definition of minimal competence. (SLD)

Describes three broad areas of challenge for the development of national curriculum content standards: (1) tension between leadership and consensus; (2) tension between flexible and specific standards; and (3) tension between up-to-date dynamic standards and reasonable expectations for systemic change. Examining tradeoffs necessary will result in…