The Auditory Automotive Mechanics Diagnostic Achievement Test assesses an automobile mechanic's ability to determine mechanical faults from auditory cues alone. The 44-item test and its instructions are recorded on magnetic tape; answer choices are presented on tape, and are also written in the printed test booklets. The norming and validity…

The family of Weibull distributions was investigated as a model for the distributions of response times for items in computer-based criterion-referenced tests. The fit of these distributions were, with a few exceptions, good to excellent according to the Kolmogorov-Smirnov test. For a few relatively simple items, the two-parameter gamma…

This primer is an introduction to item response theory (also called item characteristic curve theory, or latent trait theory) as it is used most commonly--for scoring multiple choice achievement or aptitude tests. Written for the testing practitioner with minimum training in statistics and psychometrics, it presents and illustrates the basic…

The validity, reliability, and item characteristics of the Maine Real Estate Licensure Examination were investigated. Its validity was based on its construction; a task analysis was performed on real estate broker and salesperson jobs, items were written by trained personnel; and the test was reviewed by a panel of experts. Differences in scores…

The 1973-74 Michigan Educational Assessment Program (MEAP) provided information on twenty-two separate measures of interest to educators. The program provides for measures of (1) word relationships, (2) mathematics, (3) reading and (4) attitudes (optional). In contrast to past programs, the mathematics and reading instruments are…

The ninth report of the Michigan Educational Assessment Program contains the technical information needed to evaluate the instruments and techniques used to measure and report the status of student achievement and attitude. This report is intended for people with expertise in psychometrics. The Program is described in the first section of the…

The main hypothesis was that the unit is appropriate for use at the kindergarten level. The evaluation was based upon the examination of four factors: 1) the reliability and item characteristics of the unit text; 2) the effect of bias associated with pupil sex, race, socio-economic status on geography achievement and learning gains; 3) the effect…

The Trends in International Mathematics and Science Study (TIMSS) 2003 is the third in a continuing cycle of international mathematics and science assessments conducted every four years. TIMSS assesses achievement in countries around the world and collects a rich array of information about the educational contexts for learning mathematics and…

Considers the validity of applying common assessment instruments and scales to assess the language skills of Australian school-age language learners from different first-language backgrounds. Findings reveal a strong relationship between home exposure to the language and the level of performance on the listening and reading components of the…

The author analyzes properties of mutual information between dichotomous concepts and test items. The properties generalize some common intuitions about item comparison, and provide principled foundations for designing item-selection heuristics for student assessment in computer-assisted educational systems. The proposed item-selection strategies…

Steps involved in the item analysis and scaling of the 1990 edition of Forms A and B of the Nevada High School Proficiency Examinations (NHSPEs) are described. Pilot tests of Forms A and B of the 47-item reading and 45-item mathematics tests were each administered to random samples of more than 600 eleventh-grade students. A computer program was…

Various methods used to assess the content of a test are reviewed, and a new procedure designed to improve on these methods is presented. The two tests considered are a professional licensure examination, the auditing section of the Uniform Certified Public Accountant Examination, and an educational achievement test, a nationally standardized…

Empirical studies are reviewed of sex bias and psychometric bias in aptitude and achievement tests. It is concluded that: (1) of four studies of sex bias, all found that the language used in the tests favored males, but, at the elementary-secondary level, sex bias has been decreasing; (2) of 15 analyses of psychometric bias, all found an…

This report describes the development and validation of the Unisex ACT Interest Inventory (UNIACT). In contrast to other interest inventories in common use, the UNIACT contains scales on which males and females receive similar scores. In the development of the UNIACT, more than 200 potentially sex-balanced items were administered to 10,211 people,…

This paper questions the purpose of testing in second language instruction. Comments are based on an examination of tests used by the Defense Language Institute for students of English as a second language. Two kinds of tests are used: the English Comprehension Level (ECL), used primarily as a basis for setting exit requirements, and "Book…