The effect of prior information in Bayesian estimation is considered, mainly from the standpoint of objective testing. In the estimation of a parameter belonging to an individual, the prior information is, in most cases, the density function of the population to which the individual belongs. Bayesian estimation was compared with maximum likelihood…

Two basic requirements for the successful initiation of a program for test assembly are the development of detailed item content classification systems and the delineation of the professional judgements made in building a test from a pool of items to detailed content, ability, and statistical specifications in terms precise enough to be translated…

INTERTAIL, the computer program which implements an approach to tailored testing outlined by Cliff (1975), was examined with errorless data in several Monte Carlo studies. Three replications of each cell of a 3 x 3 table with 10, 20 and 40 items and persons were analyzed. Mean rank correlation coefficients between the true order, specified by…

This study examined whether the item response curves from a two-parameter model reflected characteristics of the mathematics items, each of which required unique cognitive tasks. A computer program performed error analysis of test performance. Cognitive subtasks appeared to influence the slopes and difficulties of item response curves. (GDC)

Using a microcomputer "dart" game, this study of 61 primary school students investigated how children of different ages used counting to make numerical estimates. Results showed developmental differences in accuracy of estimation, fluency in counting and sophistication of self-reported strategy use. (BS)

Describes a study which investigated reading comprehension among fourth-quarter college French students using a computer. The main thrust of the investigation was to test recall of information in a passage that had been read five minutes previously and was unavailable for reference during the question-answering phrase. (AMH)

Instructor's opinion, student questionnaires, differences in mean test scores of computer and noncomputer classes, and differences in performance on written class tests between users and nonusers of computer tests were analyzed to investigate whether learning improved with computerized tests. Suggestions on how teachers might make use of…

This study investigated specific conditions under which out-of-scale information improves measurement precision and the factors that influence the degree of reliability gains and the amount of bias induced in the reported scores when out-of-scale information is used. In-scale information is information that an item provides for a composite trait…

This paper addresses instrumentation design and an ongoing study of an online formative assessment instrument and its effects in pre-college (developmental/remedial) mathematics courses. The use of facet theory and instructional technologies are harmonized to construct and scale an online instrument designed to document student procedures while…

This research aimed to investigate the effect of computers on the test and inter-rater reliability of writing test scores of ESL learners. Writing samples of 20 pen-paper and 20 computer group students were scored in analytic scoring method by two scorers, and then the scores were analyzed in Alpha (Cronbach) model. The results showed that the…

The purpose of this study was to determine if a relationship exists between scores and the times that medical students choose to take a computer-administered test. The results indicate that students who choose to take a test later within a given time period tend to perform less well than students who take the test earlier. Although the magnitude…

The purpose of this study was to compare and evaluate five online pretest item calibration/scaling methods in computerized adaptive testing (CAT): (1) the marginal maximum likelihood estimate with one-EM cycle (OEM); (2) the marginal maximum likelihood estimate with multiple EM cycles (MEM); (3) Stocking's Method A (M. Stocking, 1988); (4)…

Two operational item pools were used to investigate the performance of stratum computerized adaptive tests (CATs) when items were assigned to strata based on empirical estimates of item difficulty or human judgments of item difficulty. Items from the first data set consisted of 54 5-option multiple choice items from a form of the ACT mathematics…

Setting standards on educational tests is extremely challenging. The psychometric literature is replete with methods and guidelines for setting standards on educational tests; however, little attention has been paid to the process of setting standards on computerized adaptive tests (CATs). This lack of attention is unfortunate because CATs are…

Standard setting, when carefully done, can be an expensive and time-consuming process. The modified Angoff method and the benchmark method, as utilized in this study, employ representative panels of judges to provide recommended passing scores to standard setting decision-makers. It has been considered preferable to have the judges meet in a…