The concepts of universe of admissible observation and universe of generalization from the generalizability theory were applied to calculate the intraclass correlation coefficient of a licensure test. The internal consistency coefficient of a dichotomously scored test is identical to the intraclass correlation coefficient of a two-facet design.…

A total of 326 public school teachers of kindergarten through grade 12 responded to a survey about teacher-made tests, testing practices, and the availability of testing resources and guidelines. Testing practices and preferences were found to vary significantly by grade level, subject area, and length of teaching experience. School testing…

The Objective Test Scoring and Performance Rating (OTS-PR) system is a fully integrated set of 70 modular FORTRAN programs run on a VAX-8530 computer. Even with no knowledge of computers, the user can implement OTS-PR to score multiple-choice tests, include scores from external sources such as hand-scored essays or scores from nationally…

Tailored testing procedures for achievement testing were applied in a situation that failed to meet some of the specifications generally considered to be necessary for tailored testing. Discrepancies from the appropriate conditions included the use of small samples for calibrating items, and the use of an item pool that was not designed to be…

This brief review explains some alternate scoring procedures to the classical method of summing correct responses. The novel procedures attempt in some way to retrieve and use even the information in the wrong responses. (Author)

This study compares various item option scoring methods with respect to coefficient alpha and a concurrent validity coefficient. The scoring methods under consideration were: (1) formula scoring, (2) a priori scoring, (3) empirical scoring with an internal criterion, and (4) two modifications of formula scoring. The study indicates a clear…

Across the field of educational assessment the case has been made for alternatives to the multiple-choice item type. Most of the alternative types of items require a subjective evaluation by a rater. The reliability of this subjective rating is a key component of these types of alternative items. In this paper, measures of reliability are…

This study investigates the extent to which beginning to advanced students of English as a second language (ESL) understand antecedent/anaphora relationships in written discourse. The findings are related to previous research on anaphoric reference in first and second language contexts, emphasizing the significance of this factor in measurement of…

Parallel studies at universities in Israel, Finland, Canada, and the United States used a "selected deletion gap-filling test," a variation on the cloze procedure designed to measure reading comprehension by testing the reader's familiarity with cohesive links and grasp of text coherence. The test design responded to the growing demand for a more…

The content and utility of two models of reading comprehension tests, the basic skills assessment model and the multiple choice cloze (MCC) model, are discussed. The basic reading competency model assesses the ability to read or infer "basic" meanings from a range of written or symbolic communication, as is necessary for daily living in…

Among the new testing developments are the use of objectives or goals in instruction, competency based approaches to instruction, criterion referenced testing, and performance oriented testing. These new approaches often emphasize individualized learning; each student's progress is individually monitored by comparison with clear statements of what…

The matching cloze format used in constructing the reading comprehension parts of the Micronesian Achievement Test Series (MATS) is described as a holistic approach which measures skills comparable to those needed by English as a second language students in actual reading situations. Kenneth Goodman's theory about the strategies used by good…

A student's choice of an answer to a test question is a coarse measure of his knowledge about the subject matter of the question. Much finer measurement might be achieved if the student were asked to estimate, for each possible answer, the probability that it is the correct one. Such a procedure could yield two classes of benefits: (a) students…

The purpose of this study was to develop a test that could be used both to diagnose student writing needs and to evaluate the effects of classroom teaching on the abilities of secondary school-junior college students to write expositorily. Data analysis was organized to indicate the extent to which a carefully designed objective test could validly…

Recommends including essay questions on state economics examinations to prevent misclassification of students. Briefly reviews the literature arguing that certain groups of students do poorly on multiple choice tests. Discusses California's experience with adopting a combined-format type test. (MJP)