To investigate possible iPad related mode effect, we tested 403 8th graders in Indiana, Maryland, and New Jersey under three mode conditions through random assignment: a desktop computer, an iPad alone, and an iPad with an external keyboard. All students had used an iPad or computer for six months or longer. The 2-hour test included reading, math,…

This quasi-experimental study investigated how explicit instruction about multiple modes of representation (MMR) impacted grades 7 (n = 61) and 8 (n = 141) students' learning and multimodal use on end-of-unit assessments. Half of each teacher's (n = 3) students received an intervention consisting of explicit instruction on MMR in science…

Entry into a career in law enforcement is most often dependent upon the aspiring candidate's relative success on a competitive, written, multiple-choice examination. In the state of New Jersey, as in many states, civil service laws preclude consideration of formal educational attainment when establishing the ordinal, eligibles lists for law…

This study compared mathematics achievement in Illinois elementary schools using the "Everyday Math" and "Saxon Math" curricula. The Illinois Standards Achievement Test (ISAT) was used as the measure of student achievement. Multiple correlation analyses showed that the type of curriculum used was a significant predictor of…

The purpose of this article is to describe and demonstrate a three-step process of using differential distractor functioning (DDF) in a post hoc analysis to understand sources of differential item functioning (DIF) in multiple-choice testing. The process is demonstrated on two multiple-choice tests that used complex alternatives (e.g., "No…

This article investigates several questions regarding the impact of different item formats on measurement characteristics. Constructed response (CR) items and multiple choice (MC) items obviously differ in their formats and in the resources needed to score them. As such, they have been the subject of considerable discussion regarding the impact of…

This article presents a study of ethnic Differential Item Functioning (DIF) for 4th-, 7th-, and 10th-grade reading items on a state criterion-referenced achievement test. The tests, administered 1997 to 2001, were composed of multiple-choice and constructed-response items. Item performance by focal groups (i.e., students from Asian/Pacific Island,…

Based on the importance for newly licensed attorneys to conduct legal research, this study assessed the relationship between bar exam scores and scores on a test designed to measure certain important legal research skills. It also investigated whether differences in performance level among racial groups on the Research Test paralleled differences…

This research summarizes differential item functioning (DIF) results for student produced response (SPR) items, a nonmultiple-choice mathematical item type in the Scholastic Aptitude Test I (SAT I). DIF data from 4 field trial pretest administrations (620 SPR items) and 10 final forms (100 SPR items with samples ranging from about 58,000 to over…

Group comparisons for male, female, majority, and minority students were conducted for the Test of Standard Written English (TSWE). Data for two academic years and from 18 different institutions were analyzed by pooling data across institutions within each of the academic years. Analyses of data from the first academic year focused on…

The multiple-choice science exercises used by the National Assessment of Educational Progress include an "I Don't Know" (IDK) alternative to estimate more accurately knowledge of groups of respondents. Group percentages of IDK responses were examined and compared with correct responses to see if the IDK introduces bias. Variance common…

The purpose of this study was to improve both statistical and judgmental methods for detecting potentially biased test items in an attempt to examine the agreement between the results obtained with these methods. If greater agreement between methods can be achieved, test items can be more effectively screened using judgmental methods prior to…

Use of item response theory (IRT), the delta plot method, and Mantel-Haenszel techniques to assess differential item functioning (DIF) across racial and gender groups associated with the Maryland Test of Citizenship Skills (MTCS) is described. The objective of this research was to determine the: effect of sample size on results from these three…

The Science Reasoning Level Test (SRLT) was developed and administered to elementary school students in Poland and the United States, in order to determine whether a multiple choice test based on a Piaget model of the development of thought processes could be used to study the development of scientific reasoning. The relationship between reasoning…

The purpose of this article is two-fold. First, it reports on a study of the distribution of reform-oriented instructional practices among Black, White and Hispanic students, and the relationship between those practices and student achievement. The study identified many similarities in instruction across student groups, but there were some…