As part of a broader study aimed at evaluating perceived alliance with service providers and level of satisfaction with services received, 103 monolingual Spanish speaking Hispanic women were interviewed. Participants were receiving ongoing behavioral health treatment at three different community service provider sites located in the greater New…

One of the main limitations of the current generation of computer-based tests is its dependency on the multiple-choice item. This research was aimed at extending computer-based testing by bringing limited forms of performance assessment to it in the domain of mathematics. This endeavor involves not only building task types that better reflect…

This document consists of the physics 300 provincial examination (English version), a separate "provincial summary report" on the results of giving the test, and a separate French language version of the examination. This physics examination contains a 53-item multiple choice section and an 12 item free response section. Subsections of…

This paper reports the results of using a three-layer backpropagation artificial neural network to predict item difficulty in a reading comprehension test. Two network structures were developed, one with and one without a sigmoid function in the output processing unit. The data set, which consisted of a table of coded test items and corresponding…

This study focuses on possible factors which contributed to the low mathematics scores achieved by Florida's 11th graders on the 1977 Functional Literacy Test. The authors developed preliminary hypotheses to explain the low scores based upon professional conjecture, analyses of test items, and examination of item data from the October 1977 test…

CSAR (Characteristic Storage And Retrieval) is the name of an interactive item bank system for the storage, retrieval, manipulation, and summarization of information about multiple choice test items. The purpose of the system is to facilitate the test construction process. The system has two main components: one or more item banks and an…

The two conference papers comprising this document address course development and assessment procedures used in distance education at the West German Open University. The first paper, on course design and development techniques used in distance teaching, reviews some of the techniques of course evaluation and course design that have been used in…

The purpose of this book is to make it possible for measurement specialists to solve practical testing problems through the use of item response theory (IRT). The topics, organization, and presentation are those used in a 4-week seminar held each summer for the past several years. The material is organized to facilitate understanding; all related…

This text was written to help the reader acquire a base of knowledge about classical psychometrics and to integrate new ideas into that framework of knowledge. The material is organized into five units: (1) introduction to measurement theory; (2) reliability; (3) validity; (4) item analysis in test development; and (5) test scoring and…

The purpose of this paper is to link empirical Bayes methods with two specific topics in item response theory--item/subtest regression, and testing the goodness of fit of the Rasch model--under the assumptions of local independence and sufficiency. It is shown that item/subtest regression results in empirical Bayes estimates only if the Rasch…

Six editions of Scholastic Aptitude Test-Mathematical (SAT-M) were factor analyzed using confirmatory and exploratory methods. Confirmatory factor analyses (using the LISREL VI program) were conducted on correlation matrices among item parcels--sums of scores on a small subset of items. Item parcels were constructed to yield correlation matrices…

Factor analysis is the traditional method for studying the dimensionality of test data. However, under common conditions, the factor analysis of tetrachoric correlations does not recover the underlying structure of dichotomous data. The purpose of this paper is to demonstrate that the factor analyses of tetrachoric correlations is unlikely to…

The most appropriate statistical model for the small-scale (n<100) studies common in language testing research is the Rasch one-parameter logistic model. The Rasch model provides a wide range of options for conducting research, refining existing examinations, and developing tailored (computerized adaptive) language tests. Three investigations…

A study involving 29 teachers and 21 teacher educators was conducted to determine whether differences occur between the two groups on a cut-score study of the National Teacher Examination (NTE) Professional Knowledge Test. The 50 professionals were the judges for a validation and cut-score study prior to implementing use of the NTE for initial…

The purpose of this investigation was to identify item factors that may contribute to differential item functioning (DIF) for black examinees on Scholastic Aptitude Test (SAT) analogy items. Initially, items were classified according to several possible explanatory factors. Preliminary analyses identified several factors that seemed to affect DIF…