Students in the physical sciences--physics and chemistry--often take multiple-choice exams for introductory courses. Some students will write a lot on their exams, while others write very little. Does the student doing more scratch work on their exam perform better than one who does not write as much? We analyzed multiple-choice exams in physics…

Background: Erroneous answers in multiple-answer problems not only make the correct answer harder to determine but also indicate why the correct choice is suitable and the erroneous one a mistake when compared to the correct answer. However, it is insufficient to simply create erroneous answers for this purpose: explanations of these answers are…

We report the development of a multiple-choice instrument that measures the mathematical knowledge needed for teaching arithmetic with fractions, decimals, and proportions. In particular, the instrument emphasizes the knowledge needed to reason about such arithmetic when numbers are embedded in problem situations. We administered our instrument to…

The present study is concerned with assessing Logo programming experiences among seventh grade students. A formal multiple-choice test and five performance tasks were used to collect data. The results provided that students' performance was better than the expected score by the probabilistic laws, and a very low correlation between their Logo…

Little is known about how best to teach mathematics to students with learning disabilities. This study explored the performance and self-reported calculator use of 13 sixth-grade and 15 seventh-grade students with learning disabilities educated in either standards-based or traditional mathematics curricula on multiple-choice and open-ended…

The second response conditional probability model of decision-making strategies used by examinees answering multiple choice test items was revised. Increasing the number of distractors or providing distractors giving examinees (N=106) the option to follow the model improved results and gave a good fit to data for 29 of 30 items. (SLD)

Although a constructivist approach to learning calls into question the adequacy of norm-referenced, multiple-choice tests, these tests will persist into the 21st century. This article describes a classroom-based study that helped collaboratively oriented fifth graders develop problem-solving strategies to select answers to test questions. This…

Within the next two decades, calculators will be standard tools in mathematics classrooms. They should be used regularly but carefully in classroom instruction and testing to allow use of realistic data and exploration of mathematical concepts, but not to allow finding the answer without understanding the question. (MSE)

The desire for students to graduate with more than basic skills has fueled interest in performance assessment methods such as essay writing, group science experiments, or portfolio preparation. Officials in Vermont, California, Kentucky, Maryland, and other states are betting that performance assessments may prove as powerful a classroom influence…

This article examines whether an analysis of student answers to a standards-based, summative examination can be used to improve a teacher's instruction. The author, who is a chemistry teacher at Saratoga Springs High School, analyzed both the multiple-choice and the constructed response questions of the June 2003 New York State chemistry exam…

One of the main limitations of the current generation of computer-based tests is its dependency on the multiple-choice item. This research was aimed at extending computer-based testing by bringing limited forms of performance assessment to it in the domain of mathematics. This endeavor involves not only building task types that better reflect…

This report describes a methodology for increasing the validity and reliability of inferences made about the problem-solving ability of science students that is based on performance on different kinds of tests. The generalizable cognitive components of problem solving that might be targeted by assessment are described, and specifications are…

The operating characteristics of 114 mathematics pretest items from the Praxis I: Computer Based Test were analyzed in terms of item attributes and test developers' judgments of item difficulty. Item operating characteristics were defined as the difficulty, discrimination, and asymptote parameters of a three parameter logistic item response theory…

A new free-response item type for mathematics tests is described. The item type, referred to as the Student-Produced Response (SPR), was first introduced into the Preliminary Scholastic Aptitude Test/National Merit Scholarship Qualifying Test in 1993 and into the Scholastic Aptitude Test in 1994. Students solve a problem and record the answer by…

Many state and local entities are developing and using performance assessment programs. Because these initiatives are so diverse, it is very difficult to understand what they are doing, or to compare them in any meaningful way. Multiple-choice tests are contrasted with performance assessments, and preliminary classifications are suggested to…