A computer program providing comprehensive test and item analysis is presented. Completing its performance on one run, the program, written in Fortran and emphasizing ease of use, integrates various statistical techniques for analyzing individual items and the overall test, in addition to generating a variety of standard scores. (Author/JKS)

Based on the observation that scale-level methods are sometimes exclusively used to investigate measurement invariance for test translation, describes results of a simulation study investigating whether item-level differential item functioning (DIF) manifests itself in scale-level analyses such as single and multigroup factor analyses and per…

Formulas for computing the exact signed and unsigned areas between two item characteristic curves (ICCs) are presented. It is further shown that when the "c" parameters are unequal, the area between two ICCs is infinite. The significance of the exact area measures for item bias research is discussed. (Author)

A method for detecting and interpreting disturbances of the local-independence assumption among items that share common stimulus material or other features is presented. Dichotomous and polytomous Rasch models are used to analyze structure of the learning outcome superitems. (SLD)

Two discrimination coefficients, known as "disco" and "odisco," are proposed for measuring the extent of overlap in distributions as a direct function of the variance between the arithmetic means. These coefficients are related to K. Pearson's "eta" (1905) and R. A. Fisher's "F" (1950). (SLD)

It is demonstrated, theoretically and empirically, that item sets can be selected that meet the unidimensionality assumption of most item response theory models, even though they require more than one ability for a correct response. A method for identifying such item sets for test development purposes is presented. (SLD)

Discusses strategies to construct multiple-choice exams such that they can offer insight into the thought processes of the physics student. Discusses test evaluation basics and some writing hints. (JRH)

Describes investigation examining item validity and differential item functioning (DIF) on items measuring subjective well-being and coping behavior among respondents representing 338 male and 627 female members of three ethnic groups via use of log-linear models. Results offer strong evidence of item validity and some evidence of DIF. (Author/CRR)

Notes that while traditional survey literature has addressed three possible response behaviors (unit nonresponse, item nonresponse, and complete response), Web surveys can capture data about a respondent's answering process. Claims that, based on this data, at least seven response patterns are observable. Describes these seven response patterns in…

Through a large-scale simulation study, this article compares item parameter estimates obtained by the marginal maximum likelihood estimation (MMLE) and marginal Bayes modal estimation (MBME) procedures in the 3-parameter logistic model. The impact of different prior specifications on the MBME estimates is also investigated using carefully…

This study compares the parametric multiple-choice model and the nonparametric kernel smoothing approach to estimating option characteristic functions (OCCs) using an empirical criterion, the stability of curve estimates over occasions that represents random error. The potential utility of graphical OCCs in item analysis was illustrated with…

Testing is essential in education and other social science fields because many assessments, decisions, and policies are made according to the results of testing. The purpose of testing is to estimate a person's ability, that is, latent trait or construct. In a test setting, responses to a set of test items by each individual are recorded. Through…

In this paper we propose two interpretations for the discrimination parameter in the two-parameter logistic model (2PLM). The interpretations are based on the relation between the 2PLM and two stochastic models. In the first interpretation, the 2PLM is linked to a diffusion model so that the probability of absorption equals the 2PLM. The…

This study was undertaken to test the hypothesis that reading comprehension items, which elicit specific bottom-up and top-down strategies, favor certain linguistic/cultural groups. Verbal report data were collected from Arabic- and Mandarin-speaking English as a second language (ESL) learners to identify the reading strategies involved in…

Simulation and real data studies are used to investigate the value of modeling multiple-choice distractors on item response theory linking. Using the characteristic curve linking procedure for Bock's (1972) nominal response model presented by Kim and Hanson (2002), all-category linking (i.e., a linking based on all category characteristic curves…