In some testing programs an early item analysis is performed before final scoring in order to validate the intended keys. As a result, some items which are flawed and do not discriminate well may be keyed so as to give credit to examinees no matter which answer was chosen. This is referred to as allkeying. This research examined how varying the…

A case study of the Florida Teacher Certification Examination (FTCE) program was described to assist others launching the development of large scale item banks. FTCE has four subtests: Mathematics, Reading, Writing, and Professional Education. Rasch calibrated item banks have been developed for all subtests except Writing. The methods used to…

A computer simulation procedure was developed to reproduce the overall pattern of results obtained in the Educational Testing Service Growth Study. Then simulated data for seven sets of 10,000 to 15,000 cases were analyzed, and findings compared on the basis of correlations between estimated and true growth scores. Findings showed that growth was…

This brief review explains some alternate scoring procedures to the classical method of summing correct responses. The novel procedures attempt in some way to retrieve and use even the information in the wrong responses. (Author)

This study describes intergroup guessing differences in response to tests and to test-like tasks. It is a composite of seven component inquiries with three substudies in Phase 1 and four in Phase 2. These seven studies cover the Graduate Record Examination (GRE) item-type domain from a number of viewpoints relevant to implicit guessing behavior.…

Professional assessment of mental retardation (MR) and learning disabilities (LD) is crucial to the implementation of P.L. 94-142 because it necessarily precedes the employment of trained teachers and because a plan for remediation depends on accurate assessment. Intelligence is a key element in the identification of MR-LD, but competent, fair…

This study reexamines results reported by Angoff and Schrader regarding formula directions and rights directions for standardized tests. In that study, it was concluded that the two scoring directions were essentially equivalent. In this study, methodological concerns are discussed and additional data analyses undertaken. Among various…

A pilot study on the development and administration of a test using a spatial reasoning problem, the 15-puzzle, is described. The test utilizes on-line capabilities of a real-time computer to record an examinee's progress on each problem through a sequence of problem-solving "moves", and to collect additional on-line data that might be…

This study discusses the National Assessment of Educational Progress's national survey of educational achievement in art and demonstrates that it is feasible to evaluate children's drawings obtained with free response assessment techniques. Four art production exercises, each calling for pencil drawing responses, were administered during 1974-1975…

The reliability and the predictive and concurrent validity of the MATAP were investigated with the implicit goal of improving the prediction of course grades in the College of Fine and Applied Arts. It was found that reliability and validity coefficients were low, and it was suggested that the scoring system was a source of error variance. (MS)

Reviews the literature on subgroup norming in testing and examines several types of score-adjustment methods. The authors discuss social and policy perspectives as well as the scientific and theoretical underpinnings of score adjustment. (GLR)

Focuses on score adjustment by racial or ethnic group (race norming) in employment testing, and provides a history of the original controversy. The author analyzes race-based adjustments in test scores and discusses how personnel-selection science is being compromised in an effort to reconcile contradictory legal demands. (GLR)

To assess the impact of various rating scale formats in rating student teachers, a Likert-type scale (Highly agree/slightly agree/neither/slightly disagree/highly disagree) was derived from the graphic scale currently used by the cooperating teachers and university supervisors. They rated the music student teachers on an eight-point scale from…

A procedure is demonstrated for constructing tables showing, for each score on a commercial reading achievement test, the percentage of real-world materials that the testee is likely to comprehend with at least a criterion level of proficiency, the percentages of students in a local or national sample who can competently comprehend a given…