An approach was developed based on item-response models defined at the level of salient subject groups rather than at the level of individuals, designed for use with multiple-matrix sampling designs. In each of three National Assessment of Educational Progress (NAEP) mathematics subtopics, Reiser's group-effects latent trait model was fitted to…

Confirmatory factor analysis is presented as providing appropriate techniques for the analysis and evaluation of questionnaires and tests if the content of the measure can be identified as consisting of groups of items, with each group measuring only a single trait. This approach is contrasted with latent trait theory which assumes (and does not…

Prior research has indicated that items administered to college students for rating their instructors, can be empirically as well as logically classified on a continuum from very general to specific. Three of these hypothesized classifications of item specificity--global, general concept, and specific--were chosen to represent this continuum.…

Since grade-appropriate levels of standardized achievement tests must frequently be used in Elementary and Secondary Education Act Title I evaluations, there may be large discrepancies between test difficulty and the achievement level of those being tested, with resultant inaccuracies in the scores. Procedures based on the Rasch scaling model were…

The implications of a mathematical model of test scores are explored where the data are limited to a random sample of items without replacement from an indefinitely large population or item domain in which items are scored either zero or one. The purpose is to obtain an unbiased estimate of a student's proportion of items correct in the item…

Latent trait models may offer considerable potential for the improvement of educational measurement practices, but until recently, they have received only limited attention from measurement specialists. This paper provides a brief introduction to latent trait models, and provides test practitioners with a non-technical introduction to the…

The purpose of this study was to develop a measure of caring attitudes among young adults with specific reference to how persons in training for a variety of professions feel about caring for others and receiving care from them. A sample of 264 and 261 persons, ages 17 to 25, responded to the giving care and the receiving care instruments…

Objective-based assessment, known as criterion referenced testing, relies on the development of test items related directly to instructional objectives and incorporated into instruments for which predetermined criterion standards have been set. This bibliography attempts to provide in a somewhat systematic fashion, selected references concerning…

The effects of test-item selection on total test reliability and validity were investigated. It was posited that in a reading comprehension test, the knowledge displayed by the examinees is of interest only as it is a valid measure of how much a student learned from reading or comprehending a stimulus paragraph. Selection of items solely on the…

This investigation was designed to identify scales indicative of the development of problem-solving behavior in young children, and to discover whether children of different backgrounds exhibit similarities in the order of development and levels of achievement of problem-solving behaviors. Items from twenty-two tests were selected for use.…

Factor analysis of Gough's 300-item Adjective Check List identified eight highest-loading items for seven factors of self-perception. These were alphabetized and presented with 5-point scales to 713 females in teacher training. Factor analysis of the 56 self-rating items replicated the original structure, and simple scale sums showed satisfactory…

The development and implementation in a psychology department of a set of student rating-of-instruction items was discussed. The results of item descriptive statistics, correlational, and principal component analysis supported the construct validity of the items. (Author)

The study investigated whether ethnicity and gender influenced anxiety scores at different developmental levels (grades one through three). Internal evidence of test bias was examined by computing internal reliability coefficients for the anxiety measures. The two anxiety scales were found to have adequate reliability coefficients for all groups…

Computerized analysis of multiple choice test items is explained. Examples of item analysis applications in the introductory economics course are discussed with respect to three objectives: to evaluate learning; to improve test items; and to help improve classroom instruction. Problems, costs and benefits of the procedures are identified. (JMD)

Establishing stability, defined as observing minimal measurement error in a test-retest assessment, is vital to validating psychometric tools. Correlational methods, such as Pearson product-moment, intraclass, and kappa are tests of association or consistency, whereas stability or reproducibility (regarded here as synonymous) assesses the…