The Effect of Numbers of Experts and Common Items on Cutting Score Equivalents Based on Expert Judgment.

Norcini, John; And Others

Notes FAQ Contact Us

Back to results

Peer reviewed

ERIC Number: EJ443842

Record Type: Journal

Publication Date: 1991

Pages: N/A

Abstractor: N/A

ISBN: N/A

ISSN: ISSN-0146-6216

EISSN: N/A

Available Date: N/A

The Effect of Numbers of Experts and Common Items on Cutting Score Equivalents Based on Expert Judgment.

Norcini, John; And Others

Applied Psychological Measurement, v15 n3 p241-46 Sep 1991

Effects of numbers of experts (NOEs) and common items (CIs) on the scaling of cutting scores from expert judgments were studied for 11,917 physicians taking 2 forms of a medical specialty examination. Increasing NOEs and CIs reduced error; beyond 5 experts and 25 CIs, error differences were small. (SLD)

Descriptors: Comparative Testing, Cutting Scores, Equated Scores, Estimation (Mathematics), Evaluators, Licensing Examinations (Professions), Physicians, Scaling, Scoring, Standard Setting (Scoring), Test Format

Publication Type: Journal Articles; Reports - Evaluative

Education Level: N/A

Audience: N/A

Language: English

Sponsor: N/A

Authoring Institution: N/A

Grant or Contract Numbers: N/A

Author Affiliations: N/A