Testing and data integrity on statewide assessments is defined as the establishment of a comprehensive set of policies and procedures for: (1) the proper preparation of students; (2) the management and administration of the test(s) that will lead to accurate and appropriate reporting of assessment results; and (3) maintaining the security of…

The literature on item bias, i.e., the question of whether some items in tests favor one cultural group over another cultural group due to irrelevant factors, is reviewed and evaluated. All known references through 1981 are described including a large number of unpublished reports. Each method is described and the criticisms that have appeared in…

The potential of item response theory (IRT) for solving a number of testing problems in the Maryland Functional Reading Program would appear to be substantial in view of the many other promising applications of the theory. But, it is well-known that the advantages derived from an IRT model cannot be achieved when the fit between an item response…

Intended for parents, this guide discusses the effects of standardized tests on children, using test items from recent standardized reading tests which have been administered to children aged 7 to 13 and children's responses to these items. For each item, comments are made about the ambiguity of the item; the various interpretations that can be…

Information on statistical detection of two different kinds of unethical activity associated with standardized testing is presented. The first is advance presentation of specific test items or excessive coaching using items very similar to those on a test. Cluster analysis is recommended for detection of aberrant vectors of percentages correct on…

This study investigates the amount of uncertainty added to National Assessment of Educational Progress (NAEP) estimates by equating error under both ideal and less than ideal circumstances. Data from past administrations are used to guide simulations of various equating designs and error due to equating is estimated empirically. The design…

In recent years, a controversy has arisen about the advisability of allowing examinees to review their test items and possibly change answers. Arguments for and against allowing item review are discussed, and issues that a test designer should consider when designing a Computerized Adaptive Test (CAT) are identified. Most CATs do not allow…

Questions on the Scholastic Aptitude Test (SAT) with the largest score differences between women and men of all racial and ethnic groups were identified. Patterns of difficulty that would explain the SAT's continuing underprediction of female first-year college performance were studied. An item analysis of one form of the June 1986 SAT for 1,112…

This guide is designed to help parents gain a better understanding of testing and its role in the education of their children. It answers the following questions: (1) What are standardized tests? (2) What do standardized test scores tell me about my child? (3) How are standardized test scores used? (4) What are the limitations of standardized…

A norm-referenced achievement test, in combination with supplementary items, can be used to produce norm-referenced data as well as objective-referenced data. The experiences of the Palm Beach County (Florida) school district in developing and using such a test are described. (EGS)

This booklet is designed to help parents gain a better understanding of testing and its role in the education of their children. Answers to questions concerning the different types of tests given in schools, differences among these tests, how test results are used, what test scores mean and how the scores affect students are provided. Several…

There are few certifying or recertifying examinations in the medical field that are given in a take-home format. This stems from a concern that examinees may discuss items with peers, or save copies of items on the exam and then pass them on to others. This study examined if item exposure on take-home examinations influences the difficulty of the…

A parallel Spanish edition was developed of released objectives and objective-referenced items used in the National Assessment of Educational Progress (NAEP) in the field of Career and Occupational Development (COD). The Spanish edition was designed to assess the identical skills, attitudes, concepts, and knowledge of Spanish-dominant students…

Studies of the mathematics assessments of the National Assessment of Educational Progress (NAEP) are summarized. One study found that omit rates for NAEP test items were higher for African Americans and Hispanics than for whites. The other found that descriptions and examples for the 1992 mathematics achievement levels were misleading. (SLD)

This conference focused on the broad theme, improving the quality and scope of measurement. The first session centered on improving criteria for educational and psychological measurement, with papers on Criteria for Complex Mental Processes by Robert C. Wilson and on Criteria of Nonintellectual Aspects of Personality by Morris I. Stein. The second…