This report describes technical plans and progress during the second year (Fiscal Year 1984) of work on the U.S. Army's Project A: "Improving the Selection, Classification, and Utilization of Army Enlisted Personnel." Project A is a long-range research program developed by the Army Research Institute for the Behavioral and Social…

This report explores an approach to item development and psychometric modeling which explicitly incorporates knowledge about the mental models used by examinees in the solution of items into a psychometric model that characterize performances on a test, as well as incorporating that knowledge into the item development process. The paper focuses on…

The feasibility of creating an item bank from a teacher-made test was examined in two comparable sections of a graduate-level introductory measurement course. The 67-item midterm examination contained multiple-choice and master matching items, which required higher level cognitive processes such as application and analysis. The feasibility of…

A live tailored achievement testing study was conducted to compare procedures based on the one- and three-parameter logistic models. Previous studies yielded inconclusive results because of the procedures by which item calibrations were linked and because of the item selection procedures. Using improved procedures, 83 college students were tested…

The potential usefulness of computerized tests for supplementing paper-and-pencil measures for predicting job performance abilities was the objective of a series of studies. This report covers the initial test development and analysis research. Eight computerized tests were constructed to measure five personal attributes identified in previous…

Two versions of a criterion-referenced videodisc-based instrument, SHIPS (Self-Help InterPersonal Skills), have been developed for high school students with hearing impairments. Students can choose either American Sign Language or English-based sign versions of assessment items. Field testing found that use of SHIPS enhanced data validity and…

This article reports on the Pittsburgh Public Schools Oral Ratings Assessment for Language Students (PPS ORALS) project, a Title VI Foreign Language Assistance Program grant-funded project to create an online testing Software program that makes large-scale oral testing in a world language not only feasible, but also easy to create, administer, and…

The Raggio Evaluation of Attention Deficit Disorder (READD) is an objective measure for the diagnosis and management of attention deficit disorder (ADD) in children. Extensive research has been conducted on its clinical and psychometric properties, as described in Chapter 3, "Development and Standardization." The READD is a microcomputer…

An instrument was developed to measure students' engagement in various classes of study activities within multiple study contexts. This instrument is to be used in a large, ongoing research project investigating the underpinnings of student study activities and effects on academic achievement. The computer-administered instrument used--the Study…

The validity of a spatial visualization test for selecting candidate engineering students was assessed. The test was administered to 300 out of the 318 students enrolled during the winter quarter of 1989 in the Engineering Graphics 110 course at a major state university. Developmental steps undertaken to enhance the theoretical basis and validity…

In Arkansas, in reaction to complaints about traditional methods of selection for promotion, the civil service commission has chosen to base promotions in the police department solely on scores on locally-developed objective tests. Items developed and loaded into a computerized test bank were selected from six areas of responsibility: (1) criminal…

Technical advances of the last 15 years in measurement theory and practice are described, notably criterion-referenced testing, item response theory, and computers and testing. Several remaining problems concerning the development and validation of credentialing examinations are also considered. (Author/LMO)

Provides guidelines for teachers writing machine-scored examinations. Explains the use of item analysis (discrimination index) to single test items that should be improved or eliminated. Discusses validity and reliability of classroom achievement tests in contrast to norm-referenced examinations. (JHZ)

This research report describes changes made to the Inventory of Work-Relevant Values when it was revised for online use as a part of the Internet version of DISCOVER. Users will see the following differences between the online and CD-ROM versions of the inventory: 22 items rather than 61, simplified presentation, and the contribution of all items…

This paper describes efforts to devise a more effective method of assessing oral proficiency in English using a computer-based testing and computer-based test result management system. This new test would be designed to directly operationalize the second language constructs it measured, and would be developed with reference to the best practices…