Six approaches to assessing test item bias were examined: transformed item difficulty, point biserial correlations, chi-square, factor analysis, one parameter item characteristic curve, and three parameter item characteristic curve. Data sets for analysis were generated by a Monte Carlo technique based on the three parameter model; thus, four…

A procedure for interpreting multiple-discrimination indices from a multidimensional item-response theory analysis is described and demonstrated with responses of 1,635 high school students to a multiple-choice test. The procedure consists of converting discrimination parameter estimates to direction cosines and analyzing the angular distances…

Newman (1984) examined the causal relations between math self-concept and math achievement in an 8-year longitudinal study using Linear Structural Relations (LISREL) analyses. He concluded that math self-concept did not influence subsequent math achievement. However, the study suffered in that math self-concept was inferred from a single-item…

The generalizability of earlier findings on training objectives for military specialties was studied. Thirteen tasks or jobs, involving mechanical, electrical, general, or administrative aptitude, were rated by senior noncommissioned officers on: recommended field training emphaisi; present school emphasis; consequences of inadequate job…

Transformed item difficulties, chi-square, item characteristic curve (icc) theory and factor score techniques were evaluated as approaches for the identification of biased test items. The study was implemented to determine whether the approaches would provide identical classifications of items as to degree of aberrance for culturally different…

The present project was addressed to predicted success in a correspondence course. No specific hypotheses were formulated. Three schemes of analysis were conducted. The results are presented for each plan, and comparisons between the results are made. Further, recommendations for future studies are suggested. (Author)

Researchers have been limited in their ability to examine multiple constructs simultaneously due to the constraints imposed by traditional statistical methods. The most notable limitations include the need for a relatively large sample size while restricting the variables to a relatively small number. The application of a newly discovered…

The construct validity of four self-concept (SC) traits (general SC, academic SC, English SC, mathematics SC), as measured by three different scales (Likert, semantic differential, Guttman) for low- (n=252) and high-track (n=588) Canadian high school students, was assessed using both the Campbell-Fiske criteria, and a comparison of hierarchically…

The advantages of applying confirmatory factor analysis (CFA) to multitrait-multimethod (MTMM) data are widely recognized. However, because CFA as traditionally applied to MTMM data incorporates single indicators of each scale (i.e., each trait/method combination), important weaknesses are the failure to: (1) correct appropriately for measurement…

Bayesian estimation procedures are summarized and numerically illustrated by means of simulation methods. Procedures of data generation for simulation purposes are also delineated and computationally demonstrated. The logistic model basic to the Bayesian estimation procedures is shown to be explicit with respect to the probability distribution…

The validity of the assumptions under which the ordinal true score test theory was derived was examined using (1) simulation based on classical test theory; (2) a long empirical test with data from 321 sixth graders; and (3) an extensive simulation with 480 datasets based on the 3-parameter model. (SLD)

This study attempts to determine whether the pattern of human abilities varies or remains constant over a range of ability levels. Scores on 12 aptitude and achievement tests for 11,743 subjects, subdivided into four groups according to intelligence and socioeconomic status, were used. A technique, developed by Joreskog, for simultaneously factor…

This study investigates the extent to which the higher order factors of symbolic and semantic content are differentiated. The main concern is an expository description of the use of confirmatory factor analysis in establishing factorial validity. Reanalyzed data originally collected in 1968 involved a sample of 197 tenth, eleventh and twelfth…

Data from the Second International Mathematics Study for 3,724 eighth graders are used to demonstrate the potential of multilevel factor analysis (MFA) methodology. Issues related to between-class and within-class decomposition of achievement variance and the change in this decomposition over the course of the eighth grade are revealed through…

The paper identifies and addresses four methodological weaknesses common to most previous studies that have used LISREL confirmatory factor analysis to test for the factorial validity and invariance of a single measuring instrument. Specifically, the paper demonstrates the steps involved in: (1) conducting sensitivity analyses to determine a…