The methodological implications of using instructional information combined with the usual test item responses are discussed as they affect the linkage of achievement measurement and instruction. Models that expand those of standard Item Response Theory (IRT) are illustrated using achievement data from the United States sample of the Second…

The purpose of this project was to construct a valid and reliable noncurriculum specific measure of integrated science process skills intended for use with middle school students. The major efforts in test development were focused on the refinements and modifications of the set of objectives and test items assessed by the existing Middle Grades…

This study examined the psychometric characteristics of the Scholastic Aptitude Test (SAT) administered under special conditions for nine handicapped groups. Four psychometric characteristics were studied: level of test performance, test reliability, speededness, and extent of unexpected differential item performance. Psychometric comparisons were…

A one-parameter latent trait model was the basis of the test development procedures in the Basic Skills Assessment Program (BSAP) of the Department of Defense Dependents Schools (DoDDS). Several issues are involved in applying the Rasch model to an assessment program in a large school district. Separate sets of skills continua are arranged by…

Test item selection techniques based on traditional item analysis methods were compared to techniques based on item response theory. The consistency of mastery classifications in criterion referenced reading tests was examined. Pretest and posttest data were available for 945 first and second grade students and for 1796 fourth to sixth grade…

Techniques such as the norm-referenced and average score techniques, commonly used in the identification of educationally disadvantaged students, are critiqued. This study applied latent trait theory, specifically the Rasch Model, along with teacher judgments relative to the mastery of instructional/test decisions, to derive a standard setting…

This report describes the design of a test of one aspect of critical thinking ability, the ability to correctly appraise observations. Intended for classroom use with senior high school students, the 50 item Test on Appraising Observations is based on a comprehensive set of principles modified from Robert Ennes' conception of good observation…

The Rasch model for test analysis is described and compared with two-parameter and three-parameter latent-trait models. Conditional maximum likelihood equations for estimating item parameters are derived, and estimates of person parameters are described together with their confidence intervals. Goodness of fit tests are discussed, including a…

Latent trait model calibration procedures were used on data obtained from a group testing program. The one-parameter model of Wright and Panchapakesan and the three-parameter logistic model of Wingersky, Wood, and Lord were selected for comparison. These models and their corresponding estimation procedures were compared, using actual and simulated…

The "A" testing program of the Beginning Teacher Evaluation Study, Phase III-B, is summarized. A sample of 150 second grade and 134 fifth grade students completed the reading and mathematics achievement battery, as well as affective scales regarding reading, mathematics, and school. The administration procedures, test results, and psychometric…

This pamphlet reprints three papers and an invited discussion of them, read at a Division 5 Symposium at the 1975 American Psychological Association Convention. The first paper describes a Bayesian tailored testing process and shows how it demonstrates the importance of using test items with high discrimination, low guessing probability, and a…

These nine articles discuss and offer suggestions for various aspects of language teaching. In "Learning Foreign-Language Phonology: You Can't Hear It If You Can't Say It," Victor W. Mason reviews the literature supporting the proposition that accuracy of articulation is required for aural discrimination. In "Teaching Scanning," James Herbolich…

This paper reports an investigation of inferencing in Form Five of the Reading Comprehension component of the Iowa Tests of Basic Skills. The first step in the investigation consisted of an analysis of the language of the test to determine how the inferencing strategies employed might serve to mask answers. This preliminary analysis suggested that…

A pilot study was initiated to achieve reliability and especially validity indexes for measuring research and development impact. Two opposing questionnaires were administered to each of three target groups: 164 high school vocational education students, 120 secondary school vocational education teachers, and 56 vocational education…

This handbook is designed to assist teachers in using the Science Item Bank to construct diagnostic tests and end-of-course achievement tests. The item bank consists of over 2,800 multiple-choice items, and teachers are encouraged to supplement this source of test items with other forms of test questions. Key answers to these questions are arrived…