ERIC Number: ED340745
Record Type: Non-Journal
Publication Date: 1991-Nov
Pages: 12
Abstractor: N/A
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
The Relationship between Modified Angoff Knowledge Estimation Judgments and Item Difficulty Values for Seven NTE Specialty Area Tests.
Wheeler, Patricia
The appropriateness of the Angoff method (W. H. Angoff, 1971) for setting standards on tests was studied. Evaluators (judges) from California school districts and teacher training institutions reviewed 15 NTE (National Teacher Examinations) Program Specialty Area Tests published by the Educational Testing Service for their appropriateness in teacher certification in California. In this paper, data are reported from more than 25 evaluators' reviews of NTE Specialty Area Tests in the following areas: (1) art education; (2) biology and general science; (3) English language and literature; (4) mathematics; (5) physical education; (6) social studies; and (7) Spanish. Each evaluator was assigned to review only one test in his or her subject matter specialty. Each multiple-choice test was reviewed by male and female representatives of two or more ethnic groups. Evaluators estimated the percentage of hypothetical candidates who would answer each item correctly. Results support the use of the modified Angoff standard-setting method and provide evidence that evaluators are not making arbitrary decisions in estimating item difficulty for barely acceptable candidates. To set appropriate standards, it is important to have qualified evaluators, good training, and adequate data and information for evaluators to use. Four data tables and a 13-item list of references are included. (SLD)
Descriptors: Art Education, Biology, Difficulty Level, Elementary Secondary Education, English, Estimation (Mathematics), Evaluators, Higher Education, Interrater Reliability, Language Tests, Licensing Examinations (Professions), Mathematics Tests, Physical Education, Science Tests, Scoring, Social Studies, Spanish, Standard Setting (Scoring), Teacher Certification, Test Items
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: California
Grant or Contract Numbers: N/A
Author Affiliations: N/A