A statistical test for detecting answer copying on multiple-choice tests based on Cohen's kappa is proposed. The test is free of any assumptions on the response processes of the examinees suspected of copying and having served as the source, except for the usual assumption that these processes are probabilistic. Because the asymptotic null and…

In this study, the effects of different types of support for learning from multiple representations in a simulation-based learning environment were examined. The study extends known research by examining the use of dynamic representations instead of static representations and it examines the role of the complexity of the domain and the learning…

Much has been written concerning the potential group differences in responding to multiple-choice achievement test items. This discussion has included references to possible disparities in tendency to omit such test items. When test scores are used for high-stakes decision making, even small differences in scores and rankings that arise from male…

This article presents the full version of "Views on Science and Education (VOSE)" in both Chinese and English for assessing college students' and adults' views about nature of science and attitudes toward teaching issues in nature of science. The development of VOSE has been delineated in the September issue of "Science Education." The results of…

This study applied generalizability theory to investigate the contributions of persons, items, sections, and language backgrounds to the score dependability of the Test of English for International Communication (TOEIC). I replicated and extended Brown's (1999) study of the Test of English as a Foreign Language (TOEFL), using data from two…

A previous study of new item types for the analytical measure of the Graduate Record Examinations (GRE) General Test found that the new items had many factors labeled verbal reasoning, informal reasoning, formal-deductive reasoning, and quantitative reasoning. The present study examined how processing differed for these item types in the context…

Based on initial Scholastic Aptitude Test (SAT) Verbal pretest data and hypotheses advanced in the research literature, 7 sentence completion and 16 analogy items with extreme levels of differential item functioning (DIF) were selected and then systematically revised and re-administered in an attempt to reduce or eliminate DIF. The apparent…

A multiple choice test item is identified as flawed if it has no single best answer. In spite of extensive quality control procedures, the administration of flawed items to test-takers is inevitable. Common strategies for dealing with flawed items in conventional testing, grounded in the principle of fairness to test-takers, are reexamined in the…

A study was undertaken to determine the effects on essay scores of intermingling handwritten and word-processed versions of student essays. A sample of 32 examinees, each of whom had produced both a handwritten and a word-processed essay, was drawn from a larger group who had participated in a pilot study of item types for The Praxis Series:…

The purpose of this study was to determine whether it is both possible and cost-effective to revise middle-difficulty Graduate Record Examinations (GRE) discrete items in order to produce items of higher or lower difficulty. The basic procedure was to select items of a given difficulty and, by revising the distractors, make them easier or more…

The interest in the application of large-scale computerized adaptive testing has served to focus attention on issues that arise when theoretical advances are made operational. Some of these issues stem less from changes in testing conditions and more from changes in testing paradigms. One such issue is that of the order in which questions are…

Generative response modeling is an approach to test development and response modeling that calls for the creation of items in such a way that the parameters of the items on some response model can be anticipated through knowledge of the psychological processes and knowledge required to respond to the item. That is, the computer would not merely…

The accuracy of procedures that are used to compare the performance of different groups of examinees on test items obviously depends on the correct classification of members in each examinee group. The significance of this dependence is determined by the sensitivity of the statistical procedure and the proportion of examinees who are unidentified.…

A study compared the influence of two forms of discourse completion test (DCT) on the elicitation of rejection of advice. An open questionnaire providing scenarios alone was compared with a classic dialogue completion task in which a conversational turn is provided. The tasks were given to 32 graduate students, 19 native and 13 non-native…

The first of two studies reported examined the factors that predict differences in item responses for black and white matched examinees to analogies on the Graduate Record Examinations (GRE). Data were taken from 13 forms of the GRE Verbal Test, with a median sample size of 21,000 whites and a median sample size of 1,400 blacks for the purpose of…