A solution to reduce the likelihood of one examinee copying another's answers on large scale tests that require all examinees to answer the same set of questions is to use multiple test forms that differ in terms of item ordering. This study was conducted to determine whether varying the sequence in which blocks of items were presented to…

This study was designed to gather data on the meaning of imprecise terms from items written by physicians for their students and by test committees for national licensure and certification examinations. A total of 32 members of test committees who write examination items for various medical specialty examinations participated in the study. Each…

The purpose of this study was to examine the construct validity of a performance assessment program, the Maryland School Performance Assessment Program (MSPAP). Based on analyses of the longitudinal associations of Grade 5 MSPAP data in 1996 with Grade 3 MSPAP data in 1994, the following hypothesis was examined: the unattentuated correlation or…

During the Spring of 1989, the North Carolina Department of Public Instruction field-tested a geometry proof performance assessment as a component of the High School End-of-Course Testing Program (EoC). The existing geometry EoC test consisted only of multiple-choice items. The performance assessment was added to the multiple-choice component to…

The University of Iowa has been involved with the development, implementation, and operation of computer-based test-item pools and a test construction and course management system titled IPSIM (Iowa's Item Pool System for Instructional Management), originally devised for a freshman medical course in the Pathology Department of the College of…

The effort to make the Connecticut Elementary Education Certification Examination (EECE) reflect the skills and knowledge essential to successful beginning teaching is described. This instrument is planned as part of an assessment system being created by the Connecticut State Department of Education. The first element of the program is a basic…

The purpose of this study was to improve both statistical and judgmental methods for detecting potentially biased test items in an attempt to examine the agreement between the results obtained with these methods. If greater agreement between methods can be achieved, test items can be more effectively screened using judgmental methods prior to…

This study is based on data from a state-wide assessment that included both multiple-choice and constructed-response items. The intent of the study was to see whether item types make a difference in gender results. The items on both tests were categorized according to whether they assessed procedural knowledge, concepts, problem solving, or…

Student learning is the bottom line for nearly all efforts to establish a national test system. Major efforts in this area are summarized in this paper. The various efforts seem to move ahead independently, but some common ideas include: (1) creating a national assessment system rather than a single test; (2) developing more than multiple-choice…

This research examined the results from direct and indirect writing assessments to determine the most effective method of discrimination. The New Jersey State Department of Education developed a test for ninth-grade students which was designed to measure the ability to apply writing mechanics to written text and to communicate effectively in…

Use of item response theory (IRT), the delta plot method, and Mantel-Haenszel techniques to assess differential item functioning (DIF) across racial and gender groups associated with the Maryland Test of Citizenship Skills (MTCS) is described. The objective of this research was to determine the: effect of sample size on results from these three…

The reliability, content validity, and construct validity were compared for two test formats in a public examination used to assess a secondary school geography course. The 11-item geography portion of the Intermediate Certificate Examination (essay examination) was administered in June 1987 to 400 secondary school students in Ireland who also…

In 1985, for the first time, Pennsylvania's student assessment program included measures of a higher order thinking skills goal termed Analytical Thinking. These tests utilize a decision-making model to assess such skills as drawing inferences, identifying appropriate information to gather before making a decision, analogical reasoning,…

As a result of the dual roles of the National Assessment of Educational Progress (NAEP) to measure trends in academic achievement over time and to measure what students know and can do, a scale anchoring procedure was developed. Although the NAEP provides norm-referenced information about student proficiency, the scale anchoring procedure gives…

Despite the number of studies investigating affective aspects of test taking, little is known about how students perceive the kinds of extended performance assessments currently being developed for state and local testing programs. This paper presents two studies that address these issues. In the first, hands-on science tasks were administered to…