Standards-based score reports interpret test performance with reference to cut scores defining categories like "below basic," "proficient," or "master." This article first develops a conceptual framework for validity arguments supporting such interpretations, then presents three applications. Two of these serve to introduce new standard-setting…

The implicit definition of competence and the inferential chain that links the standard-setting process to the decision outcomes of the method are considered for two classes of standard-setting procedures: those involving data-free judgments of items and those involving data-based judgment of items. The major underlying assumptions of competence…

This study was conducted to: (1) determine the validity of five Educational Testing Service (ETS) tests as measures of the knowledge and academic skills required for specific endorsements of professional public school personnel in Arkansas; and (2) formulate recommendations on minimum qualifying scores for tests that are valid to use for…

In light of the widespread use of competency testing, the authors consider that it is important to determine ways of developing and using competency testing to insure that it achieves its full potential. The paper, in three parts, introduces a model for the development and validation of competency tests, reviews several methods for setting…

Before using the National Teacher Examinations (NTE) for teacher certification, states are required to conduct a state-wide validity study. This paper describes approaches used in 35 studies for 18 states to establish (NTE) content validity through curriculum and job relatedness and to establish minimum performance standards. (BS)

Although arbitrary, whenever multiple judgmental standard-setting procedures are utilized by different groups concurrently, stability across raters can be achieved and decisions can be made in a relatively judicious manner. Greater stability across methods (Ebel, Nedelsky, Angoff) may be effected by slightly modifying the Ebel approach. (Author/PN)

Evidence of the validity of the National Teacher Examinations' (NTEs') Early Childhood Education Test (ECET) as it is used in the New York City School System is presented. The NTE Core Battery and Specialty Area Tests are used as part of the alternative process for teacher licensure in New York City. The ECET measures knowledge and skills required…

A comparison of four frequently used standard setting methods for deriving cut-off scores with respect to the expected performance of minimally competent students, is presented in this paper. Ten Kansas Competency Based Tests, in reading and mathematics, were administered across five grade levels in a state-wide minimal competency testing program.…

This study examined the contribution of five categories of variables to the standard-setting recommendations of a representative sample of 241 judges recommending standards for the General Knowledge and Communication Skills Tests of the National Teacher Examinations (NTE) for the state of North Carolina. It was based on the assumption that…

A formative evaluation minimum competency test model is examined. The model systematically uses assessment information to support and facilitate program improvement. In terms of the model, four inter-related qualities are essential for a sound testing program. The content validity perspective looks at how well the district has defined competency…

The Nevada Department of Education implemented a standard setting study of the Pre-Professional Skills Tests. The tests constitute a secure test battery developed by the Educational Testing Service to assess basic proficiency in reading, writing, and mathematics via three multiple-choice tests and a written essay test. The Nevada study, in the…

This resource document represents the integration of both practice and theory related to minimum competency testing (MCT), and is largely based on information collected in a nationwide survey of MCT programs. Chapter 1, To Implement or Not to Implement MCT, by Marcy R. Perkins, presents a definition of MCT and a discussion of the perceived…

Several tests available from the Educational Testing Service (Princeton, New Jersey) have been used or are candidates for use by the Tennessee State Department of Education as initial public school personnel licensure endorsement area tests. The first of the two reports contained in this document (i.e., the Executive Report) describes a study of…

Memphis State University conducted a study for the Tennessee Department of Education to determine the validity of 11 previously unvalidated, extensively revised, or new Educational Testing Service (ETS) tests as measures of the skills and knowledge required for specific initial certification endorsements of public school personnel in Tennessee.…

Comparative data and results of validation and standard-setting studies are presented for five subject-matter tests for teacher certification in two states. The five tests evaluated were available from the Educational Testing Service (ETS): one National Teacher Examination specialty area test (special education); and four tests from a consortium…