Presents a procedure, based on a Bayesian updating of the item information, for locating on the latent trait scale the scores or responses of items that follow the three-parameter logistic and monotone partial credit models. Applications are provided in terms of selecting items or score categories for criterion-referenced interpretation of mapping…

Approaches to the determination of cut-scores have used threshold, normal ogive, linear and discrete utility functions. These approaches are examined by investigating conditions on the posterior, likelihood and utility functions required for setting cut-scores in a Bayesian approach. (Author/JKS)

Concern about passing those examinees who should pass, and retaining those who need remedial work, is one problem related to criterion-referenced testing. This paper deals with one aspect of that problem. When determining how many items to include on a criterion-referenced test, practitioners must resolve various non-statistical issues before a…

Since the primary purpose of classical testing is to rank order examinees consistently, the absolute value of the true score has been relatively unimportant. However, the major purpose of criterion referenced testing is to estimate the true capabilities of examinees to perform specific tasks. Hence, the problems of true score determination assume…

Formulas are presented for decision reliability and for classification validity for mastery/nonmastery decisions based on criterion referenced tests. Two item parameters are used: the probability of a master answering an item correctly, and the probability of a nonmaster answering an item incorrectly. The theory explores the relationships of…

A decision-theoretic procedure is outlined which provides a framework within which Bayesian statistical methods can be employed with criterion-referenced tests to improve the quality of decision making in objectives based instructional programs. (Author/DEP)

This study examined the appropriateness of the use of criterion referenced tests as a means of controlling an individual student's advancement to the next level of instruction or retention in the current unit in the PLATO Air Force Base Computer-Based Education project at Chanute. The study was also concerned with program evaluation, which…

A computer simulation of Bayes' Theorem was conducted in order to determine the probability that an examinee was a master conditional upon his test score. The inputs were: number of mastery states assumed, test length, prior expectation of masters in the examinee population, and conditional probability of a master getting a randomly selected test…

A large number of seemingly diverse coefficients have been proposed as indices of dependability, or reliability, for domain-referenced and/or mastery tests. In this paper, it is shown that most of these indices are special cases of two generalized indices of agreement: one that is corrected for chance, and one that is not. The special cases of…

The assumptions of the Criterion-Referenced Test (CRT) model proposed by Kriewall are compared to those of Emrick and Adam's Mastery-Learning (ML) model. Testing, in the context of instructional management, serves three general purposes: performance evaluation (achievement of objectives), placement (classification of students for instruction), and…

A Markov model for predicting performance on criterion-referenced tests is presented,. The model is expressed mathematically as a function of transition matrix, a current state vector, and a future state vector. The matrix is defined in terms of conditional probabilities, i.e., the probability of making a transition to a specific future…

Summarizing work which is part of an Army research program on Methodological Issues in the Construction of Criterion Referenced Tests, the focus of this paper is on a Bayesian model, which gives the probability of correctly classifying an examiner as a master or as a nonmaster while taking into consideration the test length and the mastery cut-off…

This study developed a two-parameter linear probabilistic model of criterion referenced measurement, which relates an examinee's observed ability to his true ability through a guessing parameter and a carelessness parameter, both of which are probabilities. This model was applied to a survey of 10- and 14-year-old Australian students to estimate…

The problems associated with misclassifying students when pass-fail decisions are based on test scores are discussed. One protection against misclassification is to set a confidence interval around the cutting score. Those whose scores fall above the interval are passed; those whose scores fall below the interval are failed; and those whose scores…

Latent trait theory supposes that, in testing situations, examinee performance on a test can be predicted (or explained) by defining examinee characteristics, referred to as traits, estimating scores for examinees on these traits and using the scores to predict or explain test performance (Lord and Novick, 1968). In view of the breakthroughs in…