Examines the two issues of system dimensionality and situational discrimination in a research program which entailed the training of observers on two classroom observation systems, followed by their involvement in a classroom observation experiment. (RC)

Recent advances in item analysis have provided greater capabilities for the analysis of tests, but have also significantly increased the gap between the theory and practice of item analysis. This paper traces the lines of development in item analysis under latent trait theory. (MV)

A variation of the Mantel Haenszel procedure is proposed that improves detection rates of nonuniform differential item functioning (DIF) without increasing the Type I error rate. The procedure, which is illustrated with simulated examinee responses, involves splitting the sample into low- and high-performing groups. (SLD)

Reviews the most recent version of the BILOG computer program, which estimates item and trait level parameters for the one-, two-, and three-parameter logistic unidimensional Item Response Models for dichotomously scored data. Finds this version useful. (SLD)

Counselors conducting survey research have many item format options to contemplate. This study examined midpoint selection and the effect on reliability of including or excluding midpoint options, and using both positively and negatively worded items. Findings indicate that reliability can be affected by both midpoint options and reverse coding.…

Although often ignored, reliability is critical when interpreting study effects and test results. Accordingly, this article focuses on the most commonly used estimate of reliability, internal consistency coefficients, with emphasis on coefficient alpha. An interpretive framework is provided for applied researchers and others seeking a conceptual…

Interactions between (multiple indicator) latent variables are rarely used because of implementation complexity and competing strategies. Based on 4 simulation studies, the traditional constrained approach performed more poorly than did 3 new approaches-unconstrained, generalized appended product indicator, and quasi-maximum-likelihood (QML). The…

Keying-related factors in psychological scales are variously interpreted substantively or as products of violations of the assumptions underlying item keying. The present study investigated whether the extremity of the wording of items may contribute to the emergence of item-keying factors in a commonly used psychological scale. Respondents…

Item analysis was used to find out which biochemical explanations need to be improved in biochemical teaching, not which items are to be discarded, improved, or reusable in biochemical examinations. The analysis revealed the basic facts of which less able students had more misunderstanding than able students. Identifying these basic facts helps…

The suggestion that coherent motion may serve as a test of magnocellular sensitivity is problematic. However, the nature of the problems depends on how the "magnocellular system" is defined. If this term is limited to subcortical entities, the problems are that subcortical neurons are not directionally selective, and that their receptive fields…

Constructivist ideas have influenced recent major innovations in Dutch secondary education and new curricula for reading and math in primary education, for example, pay much more attention to metacognition than before. In our study, we compared the growth of student metacognition in varying learning environments, direct instruction, and cognitive…

MicroFACT 2.0, an item factor analysis computer program, was reviewed. Program features were described in detail, as well as the program output. The performance of MicroFACT was evaluated on a Windows 2000, Pentium III platform. MicroFACT was found to be fairly easy to use, and one problem encountered was reported. Program requirements and…

It is shown that in the context of the Model with Internal Restrictions on the Item Difficulties (MIRID), different componential theories about an item set may lead to equivalent models. Furthermore, we provide conditions for the identifiability of the MIRID model parameters, and it will be shown how the MIRID model relates to the Linear Logistic…

The most recent attempt by educators to emulate the "sound principles" and methods of business and science is to become data-driven. The leaders in a data-driven school are able to demonstrate how some number, preferably scores on standardized tests, has moved upward as a result of some program they have initiated. Data-driven schools also possess…

Item exposure control, test-overlap minimization, and the efficient use of item pool are some of the important issues in computerized adaptive testing (CAT) designs. The overexposure of some items and high test-overlap rate may cause both item and test security problems. Previously these problems associated with the maximum information (Max-I)…