Six approaches to assessing test item bias were examined: transformed item difficulty, point biserial correlations, chi-square, factor analysis, one parameter item characteristic curve, and three parameter item characteristic curve. Data sets for analysis were generated by a Monte Carlo technique based on the three parameter model; thus, four…

Attempts to answer the question whether indentifiably separate levels of reading comprehension exist by judgmentally using 9 teachers at the University of Lancaster and empirically using 100 students from Bombay university. (Author/VWL)

The impact of overall test length and difficulty on the expert judgments of item performance by the Nedelsky method were studied. Five university-level instructors predicting the performance of minimally competent candidates on a mathematics examination were fairly consistent in their assessments regardless of length or difficulty of the test.…

Analogy items from the Scholastic Aptitude Test (SAT) were evaluated for differential performance by black and white examinees. Black and white examinees were first matched for overall SAT-V scores prior to conducting item analyses. A content and psycholinguistic analysis of 220 disclosed SAT analogy items from 11 test forms was performed.…

A scaling procedure is proposed, based on item response theory (IRT), to fit non-hierarchical test structure as well. The binary scores of a test of English were used for calculating the probabilities of answering each item correctly. The probability matrix was factor analyzed, and the difficulty intervals or estimates corresponding to the factors…

This paper reports on the process of modifying the ModelCreator item generation system to produce output in multiple languages. In particular, Japanese and Spanish are now supported in addition to English. The addition of multilingual functionality was considerably facilitated by the general formulation of our natural language generation system,…

This study compared student performance on language-usage test items presented in two different formats: as discrete sentences and as items embedded in passages. American College Testing (ACT) Program's Assessment experimental units were constructed that presented 40 items in the two different formats. Results suggest item presentation may not…

The problem of measuring growth across the target grade and, typically, the two adjacent grades, concerns most developers of standardized, norm-referenced achievement tests, particularly at the item selection stage. Opinion is divided on whether to retain or drop items that do not get easier from grade to grade. The controversy has focused on…

Transformed item difficulties, chi-square, item characteristic curve (icc) theory and factor score techniques were evaluated as approaches for the identification of biased test items. The study was implemented to determine whether the approaches would provide identical classifications of items as to degree of aberrance for culturally different…

This study examined differences in time needed for learning for three types of learning tasks from Bloom's taxonomy: knowledge, comprehension, and application. Seventh and eighth graders (N=88) were given five repeated trials to master three simulated classroom tasks. Large differences were found between tasks in mastery rates, information…

This document contains the framework and a set of recommendations for the NAEP 2007 mathematics assessment, which will assess student achievement nationally and state-by-state, as well as in select urban districts, in grades 4 and 8. It includes descriptions of the mathematical content of the test, the types of test questions, and recommendations…

The Cattell Culture Fair Intelligence Test (CCFIT) was administered to a large sample of American, Nigerian, and Indian adolescents, and item data were examined for cultural bias. The CCFIT was designed to measure fluid intelligence, which is not influenced by cultural differences. Four different item analysis techniques were used to determine…

A model of verbal performance was developed which defined cognitive processes thought to underlie performance on the Word Knowledge and Paragraph Comprehension subtests of the Armed Services Vocational Aptitude Battery (ASVAB). The items from two forms of these ASVAB verbal subtests were rated on five conceptualized cognitive storage processes:…

The initial study was based on responses of 103 examinees on an objective classroom test. Results indicated that response changes increased item difficulties as well as biserial and point biserial correlations. Test reliability was not decreased. This implies that not all students benefit from changing initial responses. The personal biserial…

A variety of terms related to test bias or test fairness have been used in a variety of ways, but in this document the "fair use of tests" is defined as equitable selection procedures by means of intact tests, and "test item bias" refers to the study of separate items with respect to the tests of which they are a part. Seven…