Describes an exam question which challenges college freshmen, enrolled in chemistry, to derive temperature dependence of an equilibrium constant. The question requires cognitive response at the level of synthesis. (Author/SA)

Scoring accuracy and item functioning were studied for an open-ended response type test in which correct answers can take many different surface forms. Results with 1,864 graduate school applicants showed automated scoring to approximate the accuracy of multiple-choice scoring. Items functioned similarly to other item types being considered. (SLD)

Conceptual, practical, and logistical issues in the development of science performance assessments (SPAs) are discussed. The conceptual framework identifies task, response format, and scoring system as components, and conceives of SPAs as tasks that attempt to recreate conditions in which scientists work. Developing SPAs is a sophisticated effort…

Differential item functioning for female-male and black-white groups and two samples of white males who differed in mathematical training were studied using data from 104 items from the Graduate Record Examination. Verbal properties of items were associated with differential performance of men and women but not of blacks and whites. (SLD)

Discusses how responses to multiple-choice items could be interpreted, demonstrates how responses on constructed-response items can be analyzed, and examines interactions between item characteristics and student responses. Uses information, specifically items and student responses, from the Third International Mathematics and Science Study…

Examined the performance of Irish students on multiple-choice, short-answer, and extended-response item sets from the Third International Mathematics and Science Study to determine whether Ireland's relative rank among the more than 40 countries involved remained stable. Findings provide additional evidence that comparing student achievement…

Studied the cognitive equivalence of computerized and paper-and-pencil reading comprehension tests using verbal protocol analysis. Results for 48 college students indicate that the only significant difference between the computerized and paper-and-pencil tests was in the frequency of identifying important information in the passage. (SLD)

Reviews the types of math problems grade 7 and grade 9 students attempted in class, at home, and on examinations collected during the 1999-2000 school year. Indicates that students were exposed to a variety of problem types, but the level of contextualization was low as was the level of open-endedness of the questions. (Author/KHR)

To demonstrate that some methods used to assess item fit can be applied to assess person fit and vice versa, performance of a chi-squared item-fit statistic was compared with that of a likelihood-based person-fit statistic for examinees and items under Monte Carlo conditions. (SLD)

This article demonstrates how individual differences in scripts are found in verbal reports of everyday activities as well as memory for new events, those commonly used in language placement. It is concluded from previous research that in any assessment not actively discouraging idiosyncrasies individual differences will naturally result. (PB)

This article discusses ways teachers may vary and modify teacher-made tests to better facilitate prescriptive programing for special education students. Formats featuring statements, object identification, gestures, and writing are discussed, as are item alterations in terms of both item presentation and student responses. (PB)

Provided are copy masters, instructions for use, and grading criteria for six problems used as part of the practical assessment for a modular science course. Each problem gives a narrative and a list of materials necessary to complete the problem. (CW)

A method for detecting instructional sensitivity (item bias) in test items is proposed. This method extends item response theory by allowing for item-specific variation in measurement relations across students' varying instructional backgrounds. Item bias detection is a by-product. Traditional and new methods are compared. (SLD)

Students' justifications for the three-item formats provided were compared. The study confirmed the usefulness of justifications as a diagnostic tool and offered recommendations regarding the use of justifications, including their use in the construction of two-tier items. (Author/CW)

Describes some of the problems in writing data response items in economics for use by A Level and General Certificate of Secondary Education (GCSE) students. Examines the experience of two series of workshops on writing items, evaluating them and assessing responses from schools. Offers suggestions for producing packages of data response items as…