ERIC Number: ED387505
Record Type: Non-Journal
Publication Date: 1995-Apr-20
Pages: 22
Abstractor: N/A
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
A Comparison of the Paper Selection Method and the Contrasting Groups Method for Setting Standards on Constructed-Response Items.
Webb, Melvin W., II; Miller, Eva R.
As constructed-response items become an integral part of educational assessments, setting student performance standards on constructed-response items has become an important issue. Two standard-setting methods, one used for setting standards on the National Assessment of Educational Progress (NAEP) in reading in grade 8 and the other used to set standards on the 1993 New Jersey Early Warning Test (EWT) in reading for grade 8, are compared. In the paper selection method, used for the NAEP, judges first conceptualize students who are just at the borderline between categories of performance and then select actual papers from a set of all levels of performance to represent what students at the borderline would have produced. For the EWT, the contrasting groups method was used. Judges internalize the concepts to be assessed and then select students above and below the criterion of success. Papers by these students are scored, and a point between the two score distributions is selected as the standard. Comparison suggests that the contrasting groups method may yield results that are more accurate than those of the paper selection method, although results are not definitive. Two figures and three tables illustrate the comparisons. (Contains 14 references.) (SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: National Assessment of Educational Progress
Grant or Contract Numbers: N/A
Author Affiliations: N/A