Three methods of item selection were used to select sets of 38 items from a 50-item verbal analogies test and the resulting item sets were compared for internal consistency, standard errors of measurement, item difficulty, biserial item-test correlations, and relative efficiency. Three groups of 1,500 cases each were used for item selection. First…

Unlike the past models guiding cross-cultural psychological research, a new paradigm facilitates multiple level investigations by incorporating both culture-specific (nested) and culture-general (crossed) independent variables within its partially-hierarchical framework. Based upon the generalizability analysis, this model generates sequential…

A procedure for interpreting multiple-discrimination indices from a multidimensional item-response theory analysis is described and demonstrated with responses of 1,635 high school students to a multiple-choice test. The procedure consists of converting discrimination parameter estimates to direction cosines and analyzing the angular distances…

Two approaches for conceptualizing and estimating a contextual model for analyzing student achievement are the separate equation approach and the single equation approach. The separate equation method determines the relationship between the individual-level independent variable and the individual-level dependent variable within each group. It then…

Transformed item difficulties, chi-square, item characteristic curve (icc) theory and factor score techniques were evaluated as approaches for the identification of biased test items. The study was implemented to determine whether the approaches would provide identical classifications of items as to degree of aberrance for culturally different…

Two questions are investigated here: What should the unit of analysis be in investigations of educational effects and on what basis should the units be chosen Under what conditions can relationships among measurements on individuals be estimated from the relationships among measurements on aggregates of individuals? Models using standard analysis…

Examines effects of tracking in high schools under different structural settings (selectivity, electivity, inclusiveness, and scope), using data for 20,762 students in 805 public and 78 Catholic high schools. Schools vary significantly in the magnitude of track effects on mathematics and verbal achievement. Catholic schools' tracking structures…

Six existing statistical procedures (models) for indirectly assessing the prevalence of need for alcohol, drug abuse, and mental health services across subareas of a state are described and critiqued in terms of epidemiological and statistical characteristics. Specific advantages and disadvantages are listed for each model. (SLD)

The regression-discontinuity approach to evaluating educational programs is reviewed, and regression-discontinuity post-program mean differences under various conditions are discussed. The regression-discontinuity design is used to determine whether post-program differences exist between an experimental program and a control group. The difference…

The purpose of the study was to compare two regression-based approaches for measuring educational effectiveness in Tennessee high schools: the mean residual approach (MR), and a more general linear models (LM) approach. Data were obtained from a sample of 1,011 students who were enrolled in 48 high schools, and who had taken the Comprehensive…

One of the most frequently used research methods in education and psychology involves repeated observations on the same individuals. When sample sizes are relatively small and a multivariate analysis lacks power, there are currently two analytical options in testing time effects. One is to assume a time series structure to these observations, and…

The four main approaches to measuring treatment effects in schools; raw gain, residual gain, covariance, and true scores; were compared. A simulation study showed true score analysis produced a large number of Type-I errors. When corrected for this error, this method showed the least power of the four. This outcome was clearly the result of the…

This paper reviews methods which have been used to identify and validate learning hierarchies. Specifically, three methods which reflect the notion of a relatively inviolate sequence are discussed and compared. Two of the psychometric methods compare pairs of skills, the ordering-theoretic method (Bart and Krus) and the test of inclusion (White…

The problems associated with misclassifying students when pass-fail decisions are based on test scores are discussed. One protection against misclassification is to set a confidence interval around the cutting score. Those whose scores fall above the interval are passed; those whose scores fall below the interval are failed; and those whose scores…

The role that measurement error plays in the regression effect is discussed with particular reference to the RMC models for evaluating the effects of Elementary Secondary Education Act Title I programs. The norm referenced evaluation model assumes a theory of growth where the relative ranking of students remains the same from pretest to posttest…