A comparison of four frequently used standard setting methods for deriving cut-off scores with respect to the expected performance of minimally competent students, is presented in this paper. Ten Kansas Competency Based Tests, in reading and mathematics, were administered across five grade levels in a state-wide minimal competency testing program.…

A 15-stage pyramidal test and a 40-item two-stage test were constructed and administered by computer to 111 college undergraduates. The two-stage test was found to utilize a smaller proportion of its potential score range than the pyramidal test. Score distributions for both tests were positively skewed but not significantly different from the…

This revised manual for the General Aptitude Test Battery (GATB) discusses: (1) historical development; (2) item analysis; (3) factor analysis; (4) physical format; (5) general working population norms (ages 18-54); (6) intercorrelations of raw GATB test scores and of GATB aptitude scores; (7) development of norms for specific occupations (tables…

Based on statistics from the first few administrations of the SAT writing section, the test is performing as expected. The reliability of the writing section is very similar to that of other writing assessments. Based on preliminary validity research, the writing section is expected to add modestly to the prediction of college performance when…

The supplementary information on "Alberta Essay Scales: Models" presented here includes similar models to employ in grading essays, the background and development of the scales, and the rationale for developing two scales of English mechanics and style/content. A standard is presented for evaluating current writing achievement by…

Estimates for the variance of empirically determined scoring weights are given. It is shown that test item writers should write distractors that discriminate on the criterion variable when this type of scoring is used. (Author)

An elementary survey of item characteristic curve theory, centered around the problems of individualized (tailored) testing, is presented. Following the introduction, discussions are provided of the following: Test Theory for Itemized Tests; The Guttman Scale; Item Characteristic Curve Theory; An Alternative Model; Specialization, Application, and…

This research attempted to interrelate several methods of producing option weights (i.e., Guttman internal and external weights and judges' weights) and examined their effects on reliability and on concurrent, predictive, and face validity. It was concluded that option weighting offered limited, if any, improvement over unit weighting. (Author/CTM)

This handbook, in two parts, constitutes a manual prepared by the American Federation of Teachers, for improving teachers' use of standardized tests. Part I outlines basic concepts and issues surrounding standardized testing for teachers, parents and school administrators. The terms norm-referenced tests, criterion referenced tests, minimum…

The optimal test length, using predictive validity as a criterion, depends on two major conditions: the appropriate item-difficulty rather than the total number of items, and the method used in scoring the test. These conclusions were reached when responses to a 100-item multi-level test of reading comprehension from 136 non-native speakers of…

The first four chapters of this report primarily provide an extensive, critical review of the literature with regard to selected aspects of the criterion-referenced and mastery testing fields. Major topics treated include: (a) definitions, distinctions, and background, (b) the relevance of classical test theory, (c) validity and procedures for…

This manual for examiners administering the Primary Test of Economic Understanding (PTEU) describes the purpose, development, and validity of the test which is designed to provide a measure of students' growth and a means to assess the effectiveness of existing materials, teaching strategies, and pre-service and in-service economics education…

This brief review explains some alternate scoring procedures to the classical method of summing correct responses. The novel procedures attempt in some way to retrieve and use even the information in the wrong responses. (Author)

This study compares various item option scoring methods with respect to coefficient alpha and a concurrent validity coefficient. The scoring methods under consideration were: (1) formula scoring, (2) a priori scoring, (3) empirical scoring with an internal criterion, and (4) two modifications of formula scoring. The study indicates a clear…

In order to develop tools for use in the selection and vocational-educational guidance of U.S. Naval Academy midshipmen, three empirically-based scales, designed using the Strong Vocational Interest Blank (SVIB), were developed to predict three criteria: (1) disenrollment for academic reasons, (2) disenrollment for motivational reasons, and (3)…