Three questions were addressed by this study: (1) Do the Ebel, Nedelsky, and Angoff methods of setting minimum competency standards produce different cutting scores for the same test? (2) When utilized by raters of different competencies, do these methods result in different Standards? and (3) Are the standards set by the different methods the…

Although arbitrary, whenever multiple judgmental standard-setting procedures are utilized by different groups concurrently, stability across raters can be achieved and decisions can be made in a relatively judicious manner. Greater stability across methods (Ebel, Nedelsky, Angoff) may be effected by slightly modifying the Ebel approach. (Author/PN)

Standard-setting practices in states using the National Teachers Examination (NTE) were examined. Passing score-setting procedures, recommended study scores, passing scores established by the states, and the implications of the passing scores were studied. States have typically adopted standards lower than cut scores recommended by advisory…

Focusing on the experiences of five southern states using teacher testing policies, this survey provides evidence of shared experiences and lessons learned despite the existence of five different sets of certification requirements. The first section of the report concentrates on the national context for the movement toward teacher testing.…

The effects of feedback about the ratings of other judges on subsequent ratings using the Nedelsky method and the ability of judges to retain or eliminate options in a manner consistent with the judgments of minimally competent examinees were studied using data from a basic algebra examination administered to 227 college students in 1987. The…

The impact of overall test length and difficulty on the expert judgments of item performance by the Nedelsky method were studied. Five university-level instructors predicting the performance of minimally competent candidates on a mathematics examination were fairly consistent in their assessments regardless of length or difficulty of the test.…

A panel of 24 public school teachers and 37 college/university faculty members provided recommendations on minimal standards for the essay portion of the National Teacher Examinations Communication Skills Test. Public school judges' recommendations were significantly more variable than were those of college/university judges. (TJH)

This paper describes the meeting of the Reading and Writing Advisory Committee of the New Jersey Basic Skills Council with selected high school English teachers and administrators. This panel established cut scores for statewide interpretation of the New Jersey College Basic Skills Placement Test (NJCBSPT). The NJCBSPT is administered to all…

Minimum competency cut-off scores on a statistics exam were estimated under four conditions: the Angoff judging method with item data (n=20), and without data available (n=19); and the Modified Angoff method with (n=19), and without (n=19) item data available to judges. The Angoff method required free response percentage estimates (0-100) percent,…

The Nevada Department of Education implemented a standard setting study of the Pre-Professional Skills Tests. The tests constitute a secure test battery developed by the Educational Testing Service to assess basic proficiency in reading, writing, and mathematics via three multiple-choice tests and a written essay test. The Nevada study, in the…

Memphis State University conducted a study for the Tennessee Department of Education to determine the validity of 11 previously unvalidated, extensively revised, or new Educational Testing Service (ETS) tests as measures of the skills and knowledge required for specific initial certification endorsements of public school personnel in Tennessee.…

Comparative data and results of validation and standard-setting studies are presented for five subject-matter tests for teacher certification in two states. The five tests evaluated were available from the Educational Testing Service (ETS): one National Teacher Examination specialty area test (special education); and four tests from a consortium…

In 1988 a study was conducted to determine the validity of candidate teacher licensure examinations for use in Tennessee under the 1984 Comprehensive Education Reform Act. The Department of Education conducted a study to determine the validity of 11 previously unvalidated or extensively revised tests for certification and to make recommendations…

The licensure of public school personnel in Tennessee is a function of the State Department of Education (SDE). Additional requirements for this certification function were added by the Comprehensive Education Reform Act (Senate Bill Number 1) of the 1984 Tennessee General Assembly. The Act mandated that the SDE use tests to assess the competence…

Criteria for the selection of judges (evaluators) for setting item-based standards involved in tests for which cutting scores must be established are investigated. Focus is on cases in which test standards are based on specialists' judgments concerning the difficulty of test items in tests used to determine who will be awarded a diploma, admitted…