ERIC Number: EJ1002848
Record Type: Journal
Publication Date: 2013-Jul
Pages: 16
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0749-5978
EISSN: N/A
Available Date: N/A
The Detection and Influence of Problematic Item Content in Ability Tests: An Examination of Sensitivity Review Practices for Personnel Selection Test Development
Grand, James A.; Golubovich, Juliya; Ryan, Ann Marie; Schmitt, Neal
Organizational Behavior and Human Decision Processes, v121 n2 p158-173 Jul 2013
In organizational and educational practices, sensitivity reviews are commonly advocated techniques for reducing test bias and enhancing fairness. In the present paper, results from two studies are reported which investigate how effective individuals are at detecting problematic test content and the influence such content has on important testing outcomes. In Study 1, signal detection analyses are used to examine the role of individual differences in the identification of insensitive test items, while Study 2 investigates the extent to which insensitivity differentially influences item performance and reactions. Results revealed small but significant differences in the overall accuracy and response tendencies of student test reviewers on the basis of demographics and key individual differences variables. Contrary to predictions however, problematic items did not exhibit differential item functioning across sex nor did their presence engender negative test taker reactions. Implications and suggestions for future research and sensitivity review practices are discussed. (Contains 6 tables and 2 figures.)
Descriptors: Test Items, Test Content, Test Bias, Individual Differences, Accuracy, Identification, Test Construction
Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail: usjcs@elsevier.com; Web site: http://www.elsevier.com.bibliotheek.ehb.be
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A