The analysis of small group data with hierarchical linear models is discussed, concentrating on the usefulness and reliability of such analyses using data reported by N. M. Webb (1982). Results of Webb's analyses for 96 junior high school students in small groups are compared with results obtained with random effects linear models for the analysis…

The utility of modified item response theory (IRT) models in small sample testing applications was studied. The modified IRT models were modifications of the one- and two-parameter logistic models. One-, two-, and three-parameter models were also studied. Test data were from 4 years of a national certification examination for persons desiring…

The functioning of two population-based Mantel-Haenszel (MH) common-odds ratios was compared. One ratio is conditioned on the observed test score, while the other is conditioned on a latent trait or true ability score. When the comparison group distributions are incongruent or nonoverlapping to some degree, the observed score represents different…

A new index for assessing the dimensionality underlying a set of test items was investigated. The incremental fit index (IFI) is based on the sum of squares of the residual covariances. Purposes of the study were to: (1) examine the distribution of the IFI in the null situation, with truly unidimensional data; (2) examine the rejection rate of the…

The application of the Mantel-Haenszel test statistic (and other popular DIF-detection methods) to determine DIF requires large samples, but test administrators often need to detect DIF with small samples. There is no universally agreed upon statistical approach for performing DIF analysis with small samples; hence there is substantial scope of…

A Monte Carlo study was done to determine the adequate sample size for quasi-experimental regression studies, which compare regression lines for two groups and estimate their point of intersection. Populations of 1,000 subjects in each of two groups were constructed (using random normal deviates) to yield equivalent regression lines of opposite…

A computer simulation was undertaken to determine the effects of using Huynh's single-administration estimates of the decision consistency indices for agreement and coefficient kappa, under conditions that violated the beta-binomial assumption. Included in the investigation were two unimodal score distributions that fit the model and two bimodal…

In true experiments in which sample material can be randomly assigned to treatment conditions, most researchers presume that the condition of equal sample sizes is statistically desirable. When one or more a priori contrasts can be identified which represent a few overriding experimental concerns, however, allocating sample material unequally will…

Data from 86 Early Childhood Education (ECE) projects in Oregon were analyzed using methods prescribed by the Value Added model for ECE evaluation. The extent to which appropriate model implementation procedures were followed is unknown. Thus, the results represent an empirical account of the model's estimates of project impact, rather than a…

The aims of this study were: (1) to review and discuss alternatives for evaluating members of a set of scores which may be interpreted independently as contributing to a composite score, or as a member of a profile and (2) to examine multivariate generalizability theory, as suggested by Joe and Woodward, applied to student course/instructor…

The specific objective of the research described in this report was to develop guidelines for decisionmaking by the Office of Manpower Utilization (OMU), Marine Corps Headquarters, in the selection of occupational field (OF) sample sizes to which task inventories will be administered. The report is designed to provide action-oriented answers to…

Several statistical rational and empirical procedures are presented for dealing with the problems of non-response or low return rates in surveys, namely mail surveys. Advantages and shortcomings of these procedures in educational research are discussed. (SLD)

This study of maximum likelihood confirmatory factor analysis found effects of practical significance due to sample size, the number of indicators per factor, and the number of factors for Joreskog and Sorbom's (1981) goodness-of-fit index (GFI), GFI adjusted for degrees of freedom, and the root mean square residual. (Author/BW)

A procedure is proposed for determining whether correlations obtained between two measures justify the assumption that the measures are identical. It is intended especially for small samples. In the example, the performance scales of two intelligence tests were administered to 32 deaf adolescents. (GDC)

Head Start, the largest federally funded preschool program, provides comprehensive services to economically disadvantaged children and their families so that children can enter kindergarten ready to succeed in school. Performance standards include requirements for the intensity and quality of a broad range of services for children and families.…