This report examines how selection fairness is influenced by the item characteristics of a selection instrument in terms of its distribution of item difficulties, level of item discrimination, and degree of item bias. Computer simulation was used in the administration of conventional ability tests to a hypothetical target population consisting of…

The methodological implications of using instructional information combined with the usual test item responses are discussed as they affect the linkage of achievement measurement and instruction. Models that expand those of standard Item Response Theory (IRT) are illustrated using achievement data from the United States sample of the Second…

This paper examines the development and evaluation of criterion-referenced measures, and elaborates on the distinction between them and norm-referenced measures. The concept of sensitivity is introduced as an appropriate method for evaluating such measures, and a sensitivity index is proposed. The traditional model for the response of a subject to…

Recent assessment research joining cognitive psychology and psychometric theory has introduced a new technology, item generation. In algorithmic item generation, items are systematically created based on specific combinations of features that underlie the processing required to correctly solve a problem. Reading comprehension items have been more…

We describe the item modeling development and evaluation process as applied to a quantitative assessment with high-stakes outcomes. In addition to expediting the item-creation process, a model-based approach may reduce pretesting costs, if the difficulty and discrimination of model-generated items may be predicted to a predefined level of…

A linear regression model was used to select items from a pool of 700 arithmetic word problems to be used in a computer-assisted mathematics curriculum for elementary school students. The experimental procedure first involved a stepwise linear regression analysis of a student's performance over a set of 25 problems. The probability correct for…

The content characteristics of the Test of English as a Foreign Language (TOEFL) are examined from a communicative viewpoint, based on current theory in applied linguistics and language proficiency assessment. The study employed a four-part operational framework. The first component analyzed the communicative characteristics of a language…

The principal objectives of this conference were to exchange information, discuss theoretical and empirical developments, and to coordinate research efforts. The papers and their authors are: "The Graded Response Model of Latent Trait Theory and Tailored Testing" by Fumiko Samejima; (Incomplete Orders and Computerized Testing" by…

The central assumption in domain-referenced testing (DRT), as presented in this book, is that a domain may be determined which adequately represents a particular universe of knowledge. After a domain has been established, the technological and practical problem of using domain-referenced testing must be solved. This book contains a collection of…

In September 1962, the State Board of Education initiated a broad annual study of the academic achievement and scholastic aptitude of West Virginia public schools called the State-County Testing Program. The results of this program in Region II West Virginia schools for 1965-66 - 1969-70 are analyzed to: 1) identify discernable trends; 2) find any…

More than a dozen statistical models have been developed for the purpose of cognitive diagnosis. These models are supposed to extract a much finer level of information from item responses than traditional unidimensional item response models. In this paper, a general diagnostic model (GDM) was used to analyze a set of simulated sparse data and real…

Value-added modeling (VAM) to estimate school and teacher effects is currently of considerable interest to researchers and policymakers. Recent reports suggest that VAM demonstrates the importance of teachers as a source of variance in student outcomes. Policymakers see VAM as a possible component of education reform through improved teacher…