Cognitive Diagnosis Models (CDMs) are a special family of discrete latent variable models that are widely used in educational and psychological measurement. A key component of CDMs is the Q-matrix characterizing the dependence structure between the items and the latent attributes. Additionally, researchers also assume in many applications certain…

Item response theory (IRT) refers to a family of mathematical models which describe the relationship between latent continuous variables (attributes or characteristics) and their manifestations (dichotomous/polytomous observed outcomes or responses) with regard to a set of item characteristics. Researchers typically use parametric IRT (PIRT)…

Topic models are mathematical and statistical models used to analyze textual data. The objective of topic models is to gain information about the latent semantic space of a set of related textual data. The semantic space of a set of textual data contains the relationship between documents and words and how they are used. Topic models are becoming…

Many organizations utilize some form of automation in the test assembly process; either fully algorithmic or heuristically constructed. However, one issue with heuristic models is that when the test assembly problem changes the entire model may need to be re-conceptualized and recoded. In contrast, mixed-integer programming (MIP) is a mathematical…

The online deployment of Technology Engineered online Student Ratings of Instruction (SRIs) by colleges and universities in the United States has dynamically changed the deployment of course evaluation. This research investigation is the fourth part of a post hoc study that analytically and psychometrically examines the design, reliability, and…

In this study, psychometric properties of the test of the three-mathematical minds (M3) were investigated. The M3 test was developed based on a multidimensional conception of giftedness to identify mathematically talented students. Participants included 291 middle-school students. Data analysis indicated that the M3 had a 0.73 coefficient as a…

Computerized adaptive testing is subject to security problems, as the item bank content remains operative over long periods and administration time is flexible for examinees. Spreading the content of a part of the item bank could lead to an overestimation of the examinees' trait level. The most common way of reducing this risk is to impose a…

The problem of characterizing the manifest probabilities of a latent trait model is considered. The approach taken here differs from the standard approach in that a population of examinees is being considered as opposed to a single examinee. Particular attention is given to the Rasch model. (Author/JKS)

The magnitude of statistical bias for the phi-coefficient was investigated, using computer simulated examinations in which all the students had equal knowledge. Several modifications of phi were tested, but when applied to real examinations, none succeeded in improving its reproducibility when items are re-used on equivalent student groups.…

Refined item digraph analysis (RIDA) is a way of studying diagnostic and prescriptive testing. It permits assessment of a test item's diagnostic value by examining the extent to which the item has properties of ideal items. RIDA is illustrated with the Orange Juice Test, which assesses the proportionality concept. (TJH)

Various models have been proposed for analyzing dichotomous test or questionnaire items which were constructed to reflect an assumed underlying structure (e.g., hierarchical). This paper shows that many such models are special cases of latent class analysis and discusses a currently available computer program to analyze them. (Author/JKS)

Strategies for assessing item bias are discussed. Correct response probabilities in latent trait models are compared conditional on latent ability. Probabilities are compared conditional on the observed test score in Scheuneman's method. A method to assess item bias and distinguish between uniform and nonuniform bias is described. (Author/DWH)

This paper examines the properties of the Item Efficiency Index proposed by Neill and Jackson (1976; EJ 137 077) for minimum redundancy item analysis. (Author/BW)

Both the binomial and beta-binomial models are applied to various problems occurring in mental test theory. The paper reviews and critiques these models. The emphasis is on the extensions of the models that have been proposed in recent years, and that might not be familiar to many educators. (Author)

A rating response mechanism for ordered categories such as in Likert scaling, which is related to the traditional threshold formulation but distinctively different from it, is formulated. The mechanism is based on the Rasch model. Two parameters in addition to the usual Rasch parameters are identified and discussed. (Author/JKS)