This paper describes the rationale for the Defining Issues Test (DIT), an objective test of moral judgment which attempts to improve upon three aspects of Kohlberg's research: data collection, categorization of moral judgments (the scoring system), and method of indexing a subject's progress in a developmental sequence. In each case, the way in…

Compares various item option scoring methods with respect to coefficient alpha and a concurrent validity coefficient. Scoring methods compared were: formula scoring, a priori scoring, empirical scoring with an internal criterion, and two modifications of formula scoring. The empirically determined scoring system is seen as superior. (RC)

Procedures for computing content validity and consistency reliability coefficients and determining the statistical significance of these coefficients are described. Procedures employing the multinomial probability distribution for small samples and normal curve probability estimates for large samples, can be used where judgments are made on…

Investigates the reliability and validity of scores yielded from a new scoring formula. (Author/DEP)

To replace traditional methods of minimum competency testing in personnel selection, a two stage cutting score procedure is proposed. The Angoff procedure is modified so that only a subset of test items, which assess essential job related skills, are used to determine the cutting score and to identify qualifed applicants. As a measure of item…

A project is described that was undertaken to investigate: (1) how long a cloze test has to be to achieve optimum reliability without wasting anyone's time; and (2) how cloze tests should be scored in order to obtain maximum reliability. The literature recommended 50 deletions in order to provide for an adequate sample of examinee's abilities; it…

It has been shown that Guttman weighting of test options results in marked increases in the internal consistency of a test. However, the effect of this type of weighting on the structure of the test is not known. Hence, the purpose of this study is to compare the factor structure of Guttman-weighted and rights-only-weighted tests and to relate the…

The present study was an attempt to alleviate some of the difficulties inherent in multiple-choice items by having examinees respond to multiple-choice items in a probabilistic manner. Using this format, examinees are able to respond to each alternative and to provide indications of any partial knowledge they may possess concerning the item. The…

In this paper, an attempt has been made to synthesize some of the current thinking in the area of criterion-referenced testing as well as to provide the beginning of an integration of theory and method for such testing. Since criterion-referenced testing is viewed from a decision-theoretic point of view, approaches to reliability and validity…

A potentially valuable measure of overconfidence on probabilistic multiple-choice tests was evaluated. The measure of overconfidence was based on probabilistic responses to nonsense items embedded in a vocabulary test. The test was administered under both confidence response and conventional choice response directions to 208 undergraduate…

Findings of this study suggest that it is preferable to attempt to control guessing through the use of the reward instruction rather than to attempt to control it using the penalty instruction or to encourage it using the insttruction to guess. (Authors/MB)

A study was undertaken to develop a partial credit scheme for scoring cloze-type questions on an English collocation test, obtain construct validity evidence for the test and the scoring scheme using the Rasch Partial Credit Model, and compare partial credit scoring with the more commonly used dichotomous scoring with the same test instrument.…