NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
ERIC Number: ED320944
Record Type: Non-Journal
Publication Date: 1990-Apr
Pages: 21
Abstractor: N/A
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
Some Practical Solutions to Standard-Setting Problems: The Georgia Teacher Certification Test Experience.
Cramer, Stephen E.
A standard-setting procedure was developed for the Georgia Teacher Certification Testing Program as tests in 30 teaching fields were revised. A list of important characteristics of a standard-setting procedure was derived, drawing on the work of R. A. Berk (1986). The best method was found to be a highly formalized judgmental, empirical Angoff procedure with iterations, in which content area specialists in each field would be provided, after each round of ratings, with field test results and an estimate of the effects of ratings. The data collection process used a computer-based data entry form, and each judge entered ratings onto an electronic form. At the conclusion of a round, the forms (spreadsheets) were merged with a master form that automatically calculated means and ranges of ratings and a passing score, and the computer created an output dataset to estimate passing rates and ratings for the panel. The method has been used to collect over 50,000 ratings from about 100 judges with no loss of data. In operation, the method was practical and could be administered to 20 judges by 2 staff members in a 2-day period. The method was sensitive to examinee performance data and appeared statistically sound. The method was approved by the State Board of Education, the Technical Advisory Committee, and the State Teacher Certification Testing Advisory Committee. Two tables and three figures supplement the text. (SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A