Recent assessment research joining cognitive psychology and psychometric theory has introduced a new technology, item generation. In algorithmic item generation, items are systematically created based on specific combinations of features that underlie the processing required to correctly solve a problem. Reading comprehension items have been more…

This article describes the development and use of a norm-referenced instrument called the Healthy School Indicator Tool (HSIT) that was designed to assist educational professionals monitor their progress in addressing critical health issues in schools. Factor analyses of two administrations of the survey indicated a stable factor structure. In…

Using matched pairs of geography questions, a new testing method for machine-scored fill-in-the-blank, multiple-digit testing (MDT) questions was compared to the traditional multiple-choice (MC) style. Data were from 118 matched or parallel test items for 4 tests from 764 college students of geography. The new method produced superior results when…

The keylist format (rather than the conventional multiple-choice format) for item presentation provides a machine-scorable surrogate for a truly free-response test. In this format, the examinee is required to think of an answer, look it up in a long ordered list, and enter its number on an answer sheet. The introduction of keylist items into…

This paper focuses on the questions which arise as test practitioners monitor score scales derived from latent trait theory. Large scale assessment programs are dynamic and constantly challenge the assumptions and limits of latent trait models. Even though testing programs evolve, test scores must remain reliable indicators of progress.…

This guide is designed to serve as a reference to assist providers of Job Training Partnership Act-funded programs in selecting appropriate interest, aptitude, and pre-employment and job readiness tests. Descriptions of 53 interest tests, 38 aptitude tests, and 37 pre-employment and job readiness tests are provided. Each description contains…

Perspectives on testing and grading are considered; and strategies, reference materials, and sample test items are presented. Attention is directed to specific impacts of testing and grading on students and teachers, purposes of testing and grading, and common complaints of students and teachers. Extra activities proposed for the teacher include…

The materials presented were developed for use in a series of conferences on testing and instruction sponsored by the National Institute of Education, with the United States Office of Education, the UCLA Center for the Study of Evaluation, and a network of research and development agencies. They are intended for use by school practitioners and…

The effectiveness of a model for determining a minimal cut-off score for criterion-referenced tests was examined. The model, based upon techniques presented originally by Nedelsky and by Angoff, was first used in conjunction with a multiple choice test developed for use in certifying school counselors in Georgia. A "knowledge estimation panel" was…

Simulated tailored tests were used to investigate the relationships between characteristics of the item pool and the computer program, and the reliability and bias of the resulting ability estimates. The computer program was varied to provide for various step sizes (differences in difficulty between successive steps) and different acceptance…

A questionnaire concerning attitudes toward the importance of communication skills and toward different modes of communication was administered to 290 incoming freshmen at the National Technical Institute for the Deaf. Students responded to one of two types of a 38-item questionnaire: a multiple choice, or Likert-type (strongly agree...strongly…

The Southern Illinois University School of Medicine applies mastery learning concepts to an objectives-based curriculum and uses the Nedelsky method to assess mastery of core objectives. Provisions are made for remediating deficiences. The Nedelsky technique is used for determining an acceptable level of performance in multiple choice examinations…

This report examines the "Performance Indicators in Primary Schools" (PIPS) test as a reliable and cohesive instrument to assess early literacy and numeracy skills among Indigenous children. The process includes the examination of the reliability of the PIPS test using the Cronbach Alpha and the Split-half method with Pearson's r…

Presented at the Annual National Council on Measurement in Education (NCME) in New York in March 2008. This presentation explores how different item weighting can affect the effective weights, validity coefficents and test reliability of composite scores among test takers.

This paper is a preliminary report on the development of alternate forms of an attitude scale to assess parents' and professionals' views toward the Individualized Family Service Plan (IFSP) process, a process evolving as a result of Federal regulations regarding early-intervention services. Development of the set of attitude scales is unique in…