For this project, ACT developed math and science items that attempted to represent unique aspects of cultures, raise awareness of social justice issues, promote cultural learning, be authentic and relatable, be comprehensible, and represent people in positive, nonstereotypical ways. Creating culturally relevant items was a new challenge for ACT…

The purpose of this study was to investigate if there are differences in how cognitive and noncognitive variables predict academic performance for college students with learning disabilities. In particular, this study examined the extent to which the cognitive variables of high school grade point average and SAT (combined verbal and math) or ACT…

The stability of selected indices for detecting differential item performance (item bias), from one randomly equivalent sample to another, is addressed. Some recent research has criticized these indices as too unreliable for utility in measuring bias in achievement test items. Using data from a national testing of the ACT Assessment, however, this…

The definition of differential item performance (DIP), often referred to as item bias, is discussed. DIP is suggested as a comprehensive term to encompass item bias (item invalidity which is unfair to certain population subgroups) and instructional bias (a valid reflection of group differences in instruction or background). This study investigated…

Two studies examined the effect of making the correct answer of a multiple choice test item grammatically consistent with the item. American College Testing Assessment experimental items were constructed to investigate grammatical compliance to investigate grammatical compliance for plural-singular and vowel-consonant agreement. Results suggest…

This study examined second-term and second-year retention of freshmen (n=6,054) and nonfreshman transfer students (n=2,733) from DePaul University, a large, urban, private institution. The predictor variables included both achievement and noncognitive measures collected at DePaul and on the ACT Assessment. Two questions formed the basis for this…

Eight randomly equivalent samples of high school seniors were each given a unique form of the ACT Assessment Mathematics Usage Test (ACTM). Signed measures of differential item performance (DIP) were obtained for each item in the eight ACTM forms. DIP estimates were analyzed and a significant item category effect was found. (Author/LMO)

Tables of specifications are used to guide test developers in sampling items and maintaining consistency from form to form. This paper is a generalizability study of the American College Testing Program (ACT) Achievement Program Mathematics Test (AAP), with the content areas of the table of specifications representing multiple dependent variables.…

This study investigated the effect of diagram formats on performance on geometry items in order to determine whether certain examinees are affected by different item formats and whether such differences arise from the different intellectual demands made by these formats. Thirty-two experimental, multiple-choice geometry items were administered in…

A random sample of October, 1979, test sites was selected to assess the potential bias of the ACT Assessment. From this sample, sites which tested at least five Anglos and five Hispanics were included; the final sample contained a total of 876 students (403 Anglo and 373 Hispanic). Using the primary hypothesis, "There is no interaction…

The work presented in this paper defined conceptually the concepts of multidimensional discrimination and information, derived mathematical expressions for the concepts for a particular multidimensional item response theory (IRT) model, and applied the concepts to actual test data. Multidimensional discrimination was defined as a function of the…

A procedure for the detection of differential item performance (DIP) is used to investigate the relationships between characteristics of mathematics achievement items and gender differences in performance. Eight randomly equivalent samples of high school seniors were each given a unique form of the ACT Assessment Mathematics Usage Test (ACTM).…

In the fall of 1986, a pilot study was conducted to investigate the differential performance at the item level of Mexican-American students who spoke English as a second language (ESL) versus White native English speakers. This study was designed to replicate the pilot study and test the hypotheses based on that study. The test materials used were…

This paper demonstrates the relationship between the concept of unidimensionality and direction of an item in a multidimensional space. The basic premise is that if items that measure in the same direction are combined to form a test, that test will meet the item response theory requirements of unidimensionality. This will be true even if the…

The study investigated the issue of differential selection of foils (incorrect responses) with Black English structures by black and white examinees. Linguistic research revealed systematic differences between Black English and Standard American English. Grammatical and phonological features were important distinctions. Five categories of Black…