This study has pedagogical implications in view of rapidly growing technological development and widespread use of the Internet in instruction. The spread of online homework sites with highly commercial aims has opened a new research area regarding the structure, aim and the significant role of homework in education. Particularly, the changes in…

Over a two-year period beginning in March 2004, community colleges in Maryland developed a revised set of accountability indicators for a state-mandated Performance Accountability Report first required by a 1988 statute. A major innovation was a new model for assessing student degree progress. This article explains the development and components…

This research examined the effect of tutoring on student success at an open enrollment community college, controlling for gender, age, race/ethnicity, highest level of education, and reading, writing and mathematics competency. Student success was defined three ways: term grade point average (GPA), success in courses, and persistence from the fall…

Statistical significance tests (SSTs) have been the object of much controversy among social scientists. Proponents have hailed SSTs as an objective means for minimizing the likelihood that chance factors have contributed to research results. Critics have both questioned the logic underlying SSTs and bemoaned the widespread misapplication and…

This paper examines some of the implications of testing for statistical significance. After considering methodological issues raised by two examples from the literature, the paper proceeds to look in detail at a variety of misunderstandings attached to the reporting of "significant" results. It is concluded that significance testing is of limited…

A new method for evaluating model fit that is easy to use and interpret is presented. The new method, which uses a binomial test of the number of hypotheses (paths) in a model that are supported by the data, has heuristic value when considering problems associated with other goodness-of-fit measures. An application of the binomial test as a…

The present paper suggests that multivariate techniques are very important in social science research, and that canonical correlation analysis may be particularly useful. The logic of canonical analysis is explained and discussed. The necessity of using replicability/generalizability analyses is argued. It is suggested that cross-validation…

A research design is described for the situation in which a program, particularly a compensatory education program funded by Chapter 1 of the Hawkins Stafford Act of 1988, can be evaluated when there is no available comparison group and no pretest data. The design requires content specialists to identify which objectives on the posttest were…

The use of Procrustean rotation as a procedure for assessing the invariance of study results is proposed. Researchers have long relied on significance testing as a measure of judging the worthiness of empirical findings. However, significance testing has come under fire because it does not provide information about the importance or replicability…

Identifies some errors commonly committed when educational research results are reported. (BR)

An overview of the state of the art in psychological research is presented, with an emphasis on the attention given to effect sizes. The acceptance of small effect sizes for biomedical research is contrasted with the rejection of similar effect sizes for psychological research. The Binomial Effect Size Display is used to depict the practical…

Each of the four classic multivariate analysis of variance (MANOVA) tests of statistical significance may lead a researcher to different decisions as to whether a null hypothesis should be rejected: (1) Wilks' lambda; (2) Lawley-Hotelling trace criterion; (3) Roy's greatest characteristic root criterion; and (4) Pillai's trace criterion. These…

The effectiveness of Stout's procedure for assessing latent trait unidimensionality was studied. Strong empirical evidence of the utility of the statistical test in a variety of settings is provided. The procedure was modified to correct for increased bias, and a new algorithm to determine the size of assessment sub-tests was used. The following…

In the educational research literature alpha, the a priori level of significance, and p, the a posteriori probability of obtaining a test statistic of at least a certain value when the null hypothesis is true, are often confused. Explanations for this confusion are offered. Paradoxically, alpha retains a prominent place in textbook discussions of…

The application of a multivariate analytic technique for the analysis of data from longitudinal designs with multiple dependent variables is presented. The technigue is the multivariate generalization of univariate repeated measures ANOVA. An application of the technique to data collected using materials from the Asian Studies Curriculum Project…