Academic records of first year students enrolled in Introductory Chemistry at the University of Guelph, Canada, were used to develop a method to examine the effects of individual courses on freshman academic performance. At the center of the technique is a new test statistic useful in creating individual course profiles. Because grade point…

In an effort to improve the ways in which words are learned, the Johnson O'Connor Research Foundation (JOCRF) is attempting to determine the difficulty level of all non-technical words in the English language. This item banking project entails: (1) identifying words that should be calibrated; (2) writing a test item for each word; (3) testing the…

Using estimates of item ease and item discrimination, procedures are provided for computing estimates of the reliability and percentage of failing scores for tests assembled from these items. Two assumptions are made: that the average item coefficient will be approximately equal to the average of the estimated coefficients and that the score…

The Starkweather Target Game is designed to measure preschool children's willingness to try difficult tasks independent of ability. The game consists of a box-shaped target which responds, when the target is hit by a rolled ball, somewhat like a jack-in-a-box. When the bull's eye is hit, the lid opens and a surprise picture appears. After being…

Sixty subjects participated in an experiment involving estimation of difficulty of items in a test of reasoning ability. The estimates were to be given both according to conventional conditions of magnitude estimations with a preassigned comparison standard and according to a modified procedure of magnitude estimation where the comparison standard…

This article reports the results of using a three-layer back propagation artificial neural network to predict item difficulty in a reading comprehension test. Three classes of variables were examined: text structure, propositional analysis, and cognitive demand. Results demonstrate that the networks can consistently predict item difficulty. (JL)

This study focuses on the relationship between item modeling and evidence-centered design (ECD); it considers how an appropriately generalized item modeling software tool can support systematic identification and exploitation of task-model variables, and then examines the feasibility of this goal, using linear-equation items as a test case. The…

The purpose of this study was to examine the effect that large within-examinee item difficulty variability had on estimates of the proportion of consistent classification of examinees into mastery categories over two test administrations. The classification consistency estimate was based on a single test administration from an estimation procedure…

This study used a series of simulations to answer questions about the efficacy of adaptive testing raised by empirical studies. The first study showed that for reasonable high entry points, parameters estimated from paper-and-pencil test protocols cross-validated remarkably well to groups actually tested at a computer terminal. This suggested that…

The study reported in this article is a part of a large-scale study investigating syntactic complexity in second language (L2) oral data in commonly taught foreign languages (English, German, Japanese, and Spanish; Ortega, Iwashita, Rabie, & Norris, in preparation). In this article, preliminary findings of the analysis of the Japanese data are…

This paper explores alternative approaches for facilitating efficient, evidence-centered item development for a new type of verbal reasoning item developed for use on the GRE® General Test. Results obtained in two separate studies are reported. The first study documented the development and validation of a fully automated approach for locating the…

This paper analyses the effects of manipulating the cognitive complexity of L2 oral tasks on language production. It specifically focuses on self-repairs, which are taken as a measure of accuracy since they denote both attention to form and an attempt at being accurate. By means of a repeated measures design, 42 lower-intermediate students were…

The research reported in the current article studies the impact of learning in asynchronous discussion groups on students' final exam scores and levels of knowledge construction. Multilevel analyses were applied to uncover the specific influence of student, group and task variables. The results indicate that the impact of student characteristics…

An approach is described that reveals the hierarchical test structure (HTS) based on the cognitive demands of the test items, and conducts a linear trait modeling by using the HST elements as item difficulty components. This approach, referred to as the Hierarchical Latent Trait Approach (HLTA), employs an algorithm that allows all test items to…

How accurately deltas (statistics measuring the difficulty of items) established by pre-test populations reflect deltas obtained from final form populations, and the consequent utility of pre-test deltas for constructing final (operational test) forms to meet developed statistical specifications were studied. Data were examined from five subject…