This study determined whether item forms ( rules for constructing items related to a domain or set of tasks) would enable naive item writers to generate multiple-choice items at three taxonomic levels--knowledge, comprehension, and application. Students wrote 120 multiple-choice items from 20 item forms, corresponding to educational objectives…

Simulated tailored tests were used to investigate the relationships between characteristics of the item pool and the computer program, and the reliability and bias of the resulting ability estimates. The computer program was varied to provide for various step sizes (differences in difficulty between successive steps) and different acceptance…

Twenty multiple-choice vocabulary items and 20 free-response vocabulary items were administered to 660 college students. The free-response items consisted of the stem words of the multiple-choice items. Testees were asked to respond to the free-response items with synonyms. A computer algorithm was developed to transform the numerous…

In the evaluation of Project Information Packages (PIPs), a content analysis was performed to detect congruence between items in a norm-referenced test and the content in six exemplary compensatory education program curricula. Gains on congruent items were used to assess the effectiveness of the programs. Preliminary results show that the amount…

This volume contains tables of item analysis results obtained by following procedures associated with the Rasch Model for those reading tests used in the Anchor Test Study. Appendix I gives the test names and their corresponding analysis code numbers. Section I (Basic Item Analyses) presents data for the item analysis of each test in a two part…

This paper considers the design and analysis of feeding back information about achievement test results to teachers and students in a high school classroom. An introductory section discusses the designing and administering of tests throughout the year in such a fashion as to provide pre-instruction, post-instruction, and retention achievement…

Eleven papers on language testing deal with various psycholinguistic aspects ranging from the particular application of language aptitude tests to statistical methods of measurement and evaluation. Several chapters treat the difficulties involved in testing spoken language aptitude and attainment. Contributors to this volume include K. Brown, A.…

The limitations in the methods which are usually used in stage theory test analysis to determine the stage of development of an individual are outlined. Piaget's and Kohlberg's conceptions of moral judgment are presented along with one method of estimating a subject's level of development. The concept of a latent trait is developed. Its…

The report proposes to complete the validation and refinement of a new domain referenced testing technology designed to assess literal comprehension ability in students in grades 1-12. The domain referenced measures in this technology, along with other more traditional measures of reading comprehension, literal and non-literal, are subsequently…

This volume provides a compendium of measures that could be used to evaluate the effectiveness of Head Start enhancements. The focus is on child outcome measures, although measures pertaining to intermediate outcomes related both to changes in the program and changes in the home are included. The authors also review measures and variables…

This study reports on the development, administration, and analysis of a test of collocational knowledge for English-as-a-Second-Language (ESL) learners of a wide range of proficiency levels. Through native speaker item validation and pilot testing, three subtests were developed and administered to 98 ESL learners of low-intermediate to advanced…

Item analysis data were collected for the Bender Visual Motor Gestalt Test and Goodenough-Harris Drawing Test, from urban and rural Alberta (Canada) youngsters and Inuit youngsters from the Northwest Territories (Canada). Both tests were inadequate in individual item difficulty levels, suggesting the necessity of revising scoring systems and…

More than a dozen statistical models have been developed for the purpose of cognitive diagnosis. These models are supposed to extract a much finer level of information from item responses than traditional unidimensional item response models. In this paper, a general diagnostic model (GDM) was used to analyze a set of simulated sparse data and real…

This study describes the reading and test-taking strategies that test takers used in the Reading section of the LanguEdge courseware (ETS, 2002a). These materials were developed to familiarize prospective respondents with the new TOEFL®. The investigation focused on strategies used to respond to more traditional single selection multiple-choice…

This study investigated the appropriateness of Item Response Theory (IRT) models to analyze language test data. In a university second language institute, results of typical versions of tests of French as a Second Language (n=831 examinees) and of English as a Second Language (n=617 examinees) were subjected to non-linear factor analysis in…