Fit analysis is widely performed in item response theory (IRT) based test development to assess the fit of individual items to the IRT model being used. The paper explores a step fit analysis procedure that is an extension of IRT-based item fit diagnostics applied to the response categories present in popular performance-based tasks. The step fit…

A study examined the varying degrees to which learners of Spanish at the intermediate and advanced levels use paragraph-like structure in their answers during a simulated oral proficiency exam. Subjects were 24 students preparing for the Spanish Texas Oral Proficiency Test. Data from simulated oral proficiency interviews were compared to a model…

This study investigated and compared the properties of five methods of item exposure control within the purview of estimating examinees' abilities in a computerized adaptive testing (CAT) context. Each of the exposure control algorithms was incorporated into the item selection procedure and the adaptive testing progressed based on the CAT design…

A simulation experiment demonstrated that the perceptual sensitivity of Swedish and Danish students at upper secondary school level varies systematically concerning the basic conditions for "personal growth." An attempt is made to constrain this concept contextually, in such a way that it can be described behaviorally. It is made evident…

The functioning of two population-based Mantel-Haenszel (MH) common-odds ratios was compared. One ratio is conditioned on the observed test score, while the other is conditioned on a latent trait or true ability score. When the comparison group distributions are incongruent or nonoverlapping to some degree, the observed score represents different…

This study presents an overview of Monte Carlo studies in discriminant analysis. Some common questions about the use of Monte Carlo techniques are answered through a brief literature review of articles on discriminant analysis in which Monte Carlo methods are used. The articles cover many research points, such as comparing error rate estimates,…

A new index for assessing the dimensionality underlying a set of test items was investigated. The incremental fit index (IFI) is based on the sum of squares of the residual covariances. Purposes of the study were to: (1) examine the distribution of the IFI in the null situation, with truly unidimensional data; (2) examine the rejection rate of the…

Three methods of factor analyzing dichotomously scored item performance data were compared using two raw score data sets of 20-item tests, one reflecting normally distributed latent traits and the other reflecting uniformly distributed latent traits. This comparison was accomplished by using phi and tetrachoric correlations among dichotomous data…

Predictors of novice learning in simulation environments were investigated in the domain of statistics. The first objective was to clarify the relation between intellectual ability and working method (e.g., orientation and systematical orderliness), and to determine the effects on learning of working method, independently of intellectual ability.…

Multiple group factor analysis is described and illustrated through a simulation involving 5,000 examinees. The estimation process of the group factors were implemented using the TESTFACT program of Wilson and others (1987). Group factor analysis is described as a special case of confirmatory factor analysis. Group factors can be computed based on…

Metacognitive skills may be defined in a variety of ways. Generally, these ways all apply to people's thinking about their own personal thinking. This research study analyzed students' interactions to computer programs to assess their metacognitive skills. The metacognitive skills assessed were: (1) planning a course of action; (2) monitoring the…

The purpose of this research is to demonstrate that a systematic approach to the graphical analysis of Rasch model residuals can lead to an increased understanding of ordered response data, and that residual patterns do change in predictable ways, and that summary statistics need not be the only piece of evidence for assuring the fit between model…

A study examined the relationship between organizational communication systems and organizational culture and between culture and two human relations-based outcomes--satisfaction and commitment. Subjects were 26 college students who were assigned positions in one of two simulated, bureaucratic organizations that functioned for four class periods.…

THE FOLLOWING IS THE FULL TEXT OF THIS DOCUMENT (Except for the Evaluation Summary Table): VERSION: 1.4E. PRODUCER: Earthware Computer Services, P.O. Box 30039, Eugene, OR 07403. EVALUATION COMPLETED: June 1982 by staff of NWREL and constituents of the Alaska Department of Education. COST: $49.50. ABILITY LEVEL: Secondary and College. SUBJECT:…

THE FOLLOWING IS THE FULL TEXT OF THIS DOCUMENT (Except for the Evaluation Summary Table): VERSION: Copyright 1979. PRODUCER: Mentor Software, Inc., Box 8082, St. Paul, Minnesota 55113. EVALUATION COMPLETED: March 14, 1982 by the staff and constituents of Texas Region X Educational Service Center. COST: $19.95. ABILITY LEVEL: Grade 11+. SUBJECT:…