ERIC Number: EJ682800
Record Type: Journal
Publication Date: 2004-Apr-1
Pages: 18
Abstractor: Author
ISBN: N/A
ISSN: ISSN-1062-7197
EISSN: N/A
Available Date: N/A
DIF Detection and Interpretation in Large-Scale Science Assessments: Informing Item Writing Practices
Zenisky, April L.; Hambleton, Ronald K.; Robin, Frederic
Educational Assessment, v9 n1-2 p61-78 Apr 2004
Differential item functioning (DIF) analyses are a routine part of the development of large-scale assessments. Less common are studies to understand the potential sources of DIF. The goals of this study were (a) to identify gender DIF in a large-scale science assessment and (b) to look for trends in the DIF and non-DIF items due to content, cognitive demands, item type, item text, and visual-spatial or reference factors. To facilitate the analyses, DIF studies were conducted at 3 grade levels and for 2 randomly equivalent forms of the science assessment at each grade level (administered in different years). The DIF procedure itself was a variant of the "standardization procedure" of Dorans and Kulick (1986) and was applied to very large sets of data (6 sets of data, each involving 60,000 students). It has the advantages of being easy to understand and to explain to practitioners. Several findings emerged from the study that would be useful to pass on to test development committees. For example, when there was DIF in science items, MC items tended to favor male examinees and OR items tended to favor female examinees. Compiling DIF information across multiple grades and years increases the likelihood that important trends in the data will be identified and that item writing practices will be informed by more than anecdotal reports about DIF.
Descriptors: Program Effectiveness, Test Format, Science Tests, Test Items, Item Analysis, Test Construction, Gender Bias
Lawrence Erlbaum Associates, Inc., Journal Subscription Department, 10 Industrial Avenue, Mahwah, NJ 07430-2262. Tel: 800-926-6579 (Toll Free); e-mail: journals@erlbaum.com.
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Elementary Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A