The second section of a four-part technical report of Florida's statewide program for assessing reading-related skills in grades 2 and 4 provides statistical and scoring information. Item and student sampling, a test re-scoring study, reporting statewide assessment data (percentage of achievement, types of tables used), and standard error…

The two studies described here compare essays composed on word processors with those composed with pen and paper for a standardized writing assessment. The following questions guided these studies: (1) Are there differences in test administration and writing processes associated with handwritten versus word-processor writing assessments? (2) Are…

This research attempted to interrelate several methods of producing option weights (i.e., Guttman internal and external weights and judges' weights) and examined their effects on reliability and on concurrent, predictive, and face validity. It was concluded that option weighting offered limited, if any, improvement over unit weighting. (Author/CTM)

The first four chapters of this report primarily provide an extensive, critical review of the literature with regard to selected aspects of the criterion-referenced and mastery testing fields. Major topics treated include: (a) definitions, distinctions, and background, (b) the relevance of classical test theory, (c) validity and procedures for…

This brief review explains some alternate scoring procedures to the classical method of summing correct responses. The novel procedures attempt in some way to retrieve and use even the information in the wrong responses. (Author)

This study compares various item option scoring methods with respect to coefficient alpha and a concurrent validity coefficient. The scoring methods under consideration were: (1) formula scoring, (2) a priori scoring, (3) empirical scoring with an internal criterion, and (4) two modifications of formula scoring. The study indicates a clear…

This study describes intergroup guessing differences in response to tests and to test-like tasks. It is a composite of seven component inquiries with three substudies in Phase 1 and four in Phase 2. These seven studies cover the Graduate Record Examination (GRE) item-type domain from a number of viewpoints relevant to implicit guessing behavior.…

Four systems for scoring student essays were used to classify eleventh grade and undergraduate students according to writing ability. The reliabilities of the raters and the validities of the systems in classifying students were emphasized. Two analytic scoring systems--which assume that quality writing is characterized by the inclusion of certain…

This paper outlines the development of techniques for computer-based personality assessment from sentence completions. The One-Word Sentence Completion (OWSC) instrument was designed to elicit data suitable for machine processing, while retaining most of the advantages of a free-response format. Two operative scoring systems are described. The…

Technical improvements, which may be made in the reliability and validity of tests through confidence scores, are discussed. However, studies indicate that subjects do not handle their confidence uniformly. (MS)

This paper contains in-depth explanations of the 58 scoring categories used in evaluating performance on an "in-basket" situational test for management trainees. A sample scoring sheet, respondent rating scale, and a list of possible responses are included. (DLG)

Reviews the literature on subgroup norming in testing and examines several types of score-adjustment methods. The authors discuss social and policy perspectives as well as the scientific and theoretical underpinnings of score adjustment. (GLR)

Focuses on score adjustment by racial or ethnic group (race norming) in employment testing, and provides a history of the original controversy. The author analyzes race-based adjustments in test scores and discusses how personnel-selection science is being compromised in an effort to reconcile contradictory legal demands. (GLR)

The admissable probability measurement (APM) format was used to score a criterion referenced language arts test administered in an inner city junior high school. Its 30 items covered capitalization, punctuation, parts of speech, and sentence analysis. With APM, students indicate their confidence in their answer choice, and guessing is heavily…

Development of The Assessment of Basic Competencies (ABC), a test battery based on the three-parameter logistic model, is described. Eleven dimensions of intellectual growth are measured, from the pre-kindergarten level through ninth grade. An educationally relevant skill domain is represented by each test. Unique properties of the test, based on…