This study replicates and extends a 2004 content analysis of three major higher education journals. The original study examined the methodological characteristics of all published research in these journals from 1996 to 2000, recommending that higher education programs adjust their graduate training to better match the heavily quantitative and…

The concept of control is fundamental to comparative research. In research designs where randomization of observational units is not possible, control has been exercised statistically from a single covariate by a process of residualization. The alternative, known as subclassification on the propensity score, was developed primarily for…

The stepwise regression method of selecting predictors for computer assisted multiple regression analysis was compared with forward, backward, and best subsets regression, using 16 data sets. The results indicated the stepwise method was preferred because of its practical nature, when the models chosen by different selection methods were similar…

Evaluations involving nonrandom assignment to treatment or control groups are vulnerable to an accidental or intentional confounding of a selection effect with the treatment effect. Two techniques, discriminant analysis and base expectancy analysis, permit separate estimation of the selection and treatment effects in the final results. (Author/CTM)

A general model is described which can be used to represent the four common types of meta-analysis: (1) estimation of effect size by combining study outcomes; (2) estimation of effect size by contrasting study outcomes; (3) estimation of statistical significance by combining study outcomes; and (4) estimation of statistical significance by…

Hypothetical data sets are used to demonstrate how canonical correlation methods subsume other commonly utilized parametric methods. Analysis of variance, analysis of covariance, multiple analysis of variance, and multiple analysis of covariance are heavily used by educational researchers. It is concluded that researchers would do well to consider…

This paper reports the results of a Monte Carlo investigation of Type I errors in the single group repeated measures design where multiple measures are collected from each observational unit at each measurement occasion. The Type I error of three multivariate tests were examined. These were the doubly multivariate F test, the multivariate mixed…

Data drawn from 30 journal articles and ERIC documents reporting on gender differences in natural science achievement were re-examined. Three meta-analysis methods were used: (1) vote counts and vote-counting estimation procedures; (2) tests of combined significance; and (3) analyses of effect sizes. The three methods produced seemingly…

The central purpose of this study was to examine the relationship between distribution of teaching talent and geographic location of local school districts of California. School districts were assigned to one of four geographic categories (urban, suburban, rural, or small urban centers). Each category's teaching talent was assessed on six measures…

A study explored which nonexperimental comparison group methods provide the most accurate estimates of the impacts of mandatory welfare-to-work programs and whether the best methods work well enough to substitute for random assignment experiments. Findings were compared for nonexperimental comparison groups and statistical adjustment procedures…

This is the first in a series of reports which summarize research studies dealing with college level economics education that is personalized, individualized, or self paced. The major purpose is to inform interested economic educators of the studies that have been done, to summarize the results, and to identify various research designs and…