The Advanced Placement (AP) program is a cooperative educational effort of secondary schools, colleges, and the College Board that consists of 30 college-level courses and examinations in 17 academic disciplines for highly motivated students in secondary schools. AP courses are offered in more than 11,000 high schools and are recognized by nearly…

Different aspects of text comprehension and different evaluation procedures were studied for elementary school students. Indicators sensitive to the different levels of comprehension involved were used, and recall was divided into recall macro, micro, and total. The sample consisted of 90 sixth graders in the national capital region of Canada.…

This guide is designed to give the student helpful information about Arizona's Instrument To Measure the Standards (AIMS) for grade 8. The guide provides examples of the type of questions students see on AIMS and explains how items are scored. It does not teach what the student needs to know to do well on AIMS, but it will help the student know…

This report presents a study that examined the effects of symptom item formats on estimates of risk status across alternative attention deficit hyperactivity disorder (ADHD) behavior checklists for 38 referred children. The mean age of the children was 7 years 9 months. The study focused on ADHD risk as measured by two behavior checklists which…

The SAT® I: Reasoning Test is administered seven times a year. Primarily for security purposes, several different test forms are given at each administration. How is it possible to compare scores obtained from different test forms and from different test administrations? The purpose of this paper is to provide an overview of the statistical…

Three studies compared the common Likert agree/disagree question form to a behavioral observation form for faculty evaluation. The Likert-type format prompted global, impressionistic responses; the behavioral observation form prompted more objective responses. Results suggest use of behavioral observation rather than agree/disagree questions can…

This study, involving 30 elementary students with learning disabilities, found that students performed significantly better on mathematics tests given using a computer than by paper and pencil. It found no differences among variations of computer-assisted instruction, with either static or animated pictures and either utilizing or not utilizing a…

Test modifications and techniques that teachers can employ to adapt their tests to meet individualized needs of mainstreamed students with disabilities are considered. Suggestions are offered to assist special education teachers in helping general educators design tests; address test reliability, validity, content, and format; and develop…

Several multiple-choice item formats are examined in the current climate of test reform. The reform movement is discussed as it affects use of the following formats: (1) complex multiple-choice; (2) alternate choice; (3) true-false; (4) multiple true-false; and (5) the context dependent item set. (SLD)

Presents a study of the effect of question order on student performance on economics tests. Reports that question order has no statistically significant effect on examination scores, even after including variables that reflect differential human capital characteristics. Concludes that instructors need not worry that some examination versions give…

Effects of question length and explicitness of directions (format) were examined for 97 university students answering open-ended consumer satisfaction questions at 9 health promotion workshops. Question format, but not length, was related to the usefulness of answers. Implications for use and construction of open-ended questions are discussed.…

The relationship of multiple-choice and free-response items on the College Board's Advanced Placement Computer Science Examination was studied using confirmatory factor analysis. Results with 2 samples of 1,000 high school students suggested that the most parsimonious fit was achieved using a single factor. Implications for construct validity are…

The consistency of several item bias detection methods was studied across different test administrations of the same items using data from a mathematics test given to approximately 6,600 eighth grade students in all. The Mantel Haenszel and item-response-theory-based sum-of-squares methods were the most consistent. (SLD)

The effect of multiple-choice (MC) or open-ended (OE) response format on diagnostic assessment of algebra test performance was investigated with 231 eighth and ninth graders in Tel Aviv (Israel) using bug or rule space analysis. Both analyses indicated closer similarity between parallel OE subsets than between stem-equivalent OE and MC subsets.…

Differential item functioning on 6 forms of the Scholastic Aptitude Test was examined for 181,228 male and 198,668 female students focusing on the points tested, the test format, and subject matter in which items are embedded. Implications of the identifiable differences are discussed. (SLD)