A new assessment conception is described that integrates constructed-response testing, artificial intelligence, and model-based measurement. The conception incorporates complex constructed-response items for their potential to increase the validity, instructional utility, and credibility of standardized tests. Artificial intelligence methods are…

This volume is the fourth in a series for college faculty and advanced graduate students, "Survival Skills for Scholars." It offers practical advice for developing, using, and grading classroom examinations, focusing on traditional multiple-choice and constructed-response tests rather than alternative assessments. (SLD)

This essay explores what is known and what remains to be learned about the information value of performance items when they are used in large scale assessment. Within the context of the National Assessment of Educational Progress (NAEP), there is substantial interest in answering these questions as issues of national assessment are considered for…

Contrasts between constructed response items and stem-equivalent multiple-choice counterparts typically have involved averaging item characteristics, and this aggregation has masked differences in statistical properties at the item level. Moreover, even aggregated format differences have not been explained in terms of differential cognitive…

To investigate the ability of multiple-choice tests to assess higher order thinking skills, examinations were constructed as half multiple choice and half constructed response. Results with 90 undergraduate and graduate students indicate that the 2 formats measure similar constructs at different levels of complexity. (SLD)

This book is intended to help parents understand more about the tests their children take in school. The pros and cons of different types of tests are explained, and the proper use of standardized tests is discussed. Each chapter contains a brief summary of the topic, with follow-up activities and a list of resources a parent could bring to the…

Fitting item response models to data from 2 Advanced Placement exams (18,462 and 82,842 students) demonstrates that constructed response items add little to information provided by multiple choice and that scoring on the basis of student item selection gives almost as much information as scoring on the basis of answers. (SLD)

Discusses how recent court decisions and the move toward performance assessment may affect the adverse impact, reliability, validity, and pass-fail standards of teacher-certification tests. Recommendations are made for tests that combine multiple-choice items with open-ended tasks. (SLD)

Analyses based on fitting item response models to data from the College Board's Advanced Placement exams in Chemistry and United States History indicated that the constructed-response portion of the tests yielded little information over and above that provided by the multiple-choice sections. These tests also allow examinees to select subsets of…

This paper looks at alternative assessment and explores its place in educational reform. It gives a snapshot of alternative assessment in practice, guidelines for establishing it as part of the urban school culture, and resources for additional information. Alternative assessments differ from traditional tests in that they require students to…

This manual contains information about the contents of a database that provides information about efforts to match changing goals for student achievement to ideas about instruction. The database, available on disk, contains descriptive information on alternative assessments in science and mathematics. The database uses a broad definition of…

This book contains necessary information to help teachers deal with the assessment concerns of classroom teachers. The major theme is that classroom assessment should help teachers make better educational decisions. Each chapter contains several elements intended to foster mastery of its contents, including a summary of contents, a more succinct…

Focusing on educational measurement that suggests an action and has an outcome, 16 problem areas are defined and grouped into the following classes: (1) validity; (2) issues of statistical adjustment; (3) data insufficiencies; (4) other issues related to standardized testing and constructed responses; and (5) technical issues of psychometrics.…

The Center for Research on Evaluation, Standards, and Student Testing (CRESST) has developed an Alternative Assessments in Practice Data Base to support technical assistance needs and to promote the exchange of new assessment ideas. The database is designed to provide easy access and retrieval of information about ongoing and newly developed…

Issues of the relative costs of multiple choice tests and alternative types of assessment are explored. Before alternative assessments in large-scale or small-scale programs are used, attention must be given to cost considerations and the resources required to develop and implement the assessment. Major categories of cost to be considered are…