The purpose of this study was to use realistically simulated data to evaluate various CAT designs for use with the verbal reasoning measure of the Medical College Admissions Test (MCAT). Factors such as item pool depth, content constraints, and item formats often cause repeated adaptive administrations of an item at ability levels that are not…

This study investigated the effects of three aspects of language testing (test task, familiarity with an interviewer, and test method) on both tester and tested. Data were drawn from several previous studies by the researcher. Concerning test task, data were analyzed for the type of topic students wanted most to talk about or preferred not to talk…

This test manual presents information on the Brockport Physical Fitness Test (BPFT), a criterion-referenced fitness test for children and adolescents with disabilities. The first chapter of the test manual includes an introduction and target populations are identified, defined, and classified. The second chapter presents information on the…

Recent findings on differential item functioning (DIF) for minority examinees (Asian Americans, Hispanics, and Blacks) taking the Scholastic Aptitude Test (SAT) are presented, and the standardization approach to assessing DIF is described. Item characteristics related to DIF that generalize across ethnic groups are discussed. (SLD)

The validity of logistic test models and computer simulation methods for generating sampling distributions of item bias statistics was evaluated under the hypothesis of no item bias. Test data from 937 ninth-grade students were used to develop 7 steps for applying computer-simulated baseline statistics in test development. (SLD)

Describes responses of fifth to eighth grade students to different types of test items requiring estimation. Reports that performance differed by item format, types of numbers and operations in the items, and grade level of students. (Author/YP)

A study of the effectiveness of teaching science to 2 classes of 15 and 20 ninth-graders, respectively, illustrates 5 aspects of educational evaluation: age factors in teachability, test unidimensionality, comparison of 2 classes of students regarding mean ability, objective difficulty of test items, and objective ability of individual students.…

Examinees in a regular administration of the quantitative portion of the Graduate Record Examination responded to particular items in a machine-scannable multiple-choice format. Volunteers (n=364) used a computer to answer open-ended counterparts of these items. Scores for both formats demonstrated similar correlational patterns. (SLD)

Results from the Maryland School Performance Assessment Program for 5,392 elementary school students and from the Comprehensive Tests of Basic Skills (multiple choice) for a national sample are used to explore local item independence (LID) of test items. Some strategies are suggested for measuring LID in performance assessments. (SLD)

The aim of this study was to develop and validate a team-referent attribution scale. Conducted over three studies, Study 1 modified items from McAuley, Duncan, and Russell's (1992) Causal Dimension Scale II by rewording items to reflect team attributions and adding one item per factor. This led to the development of a 16-item scale (Causal…

This study used a diagnostic testing approach to compare the mathematics achievement of eighth-grade students across a sample of 20 countries, analyzing data from the Third International Math and Science Study-Revised (TIMSS-R, 1999). Using the rule-space method, student mastery was measured on 23 specific content knowledge and processing…

This article describes two studies that examined the effects of pictorial and written annotations on second language (L2) vocabulary learning from a multimedia environment. In both studies, students were randomly assigned to one of four aural multimedia groups: a control group that received no annotations, and three treatment groups that provided…

This article describes the development and use of a norm-referenced instrument called the Healthy School Indicator Tool (HSIT) that was designed to assist educational professionals monitor their progress in addressing critical health issues in schools. Factor analyses of two administrations of the survey indicated a stable factor structure. In…

This paper examines the effect of gender on English reading comprehension for Korean EFL (English as a Foreign Language) learners. The gender effect was measured using a DIF (Differential Item Functioning) methodology. Specifically, gender DIF was investigated for a random sample of 14,000 Korean examinees (7,000 males and 7,000 females) who took…

The No Child Left Behind Act of 2001 (NCLB) requires the reporting of participation in assessments overall and by subgroup, including students with disabilities. As states and school districts strive to meet the goals for adequate yearly progress required by NCLB, the use of individual accommodations continues to be scrutinized for effectiveness,…