Eight different methods are reviewed for determining whether two or more tests are equivalent measures. These methods vary in restrictiveness from the Wilks-Votaw test of compound symmetry (which requires that all means, variances, and covariances are equal), to Joreskog's theory of congeneric tests (which requires only that the tests are measures…

When repeated measures are obtained on the same subjects, interobservation dependencies frequently are generated. The major ways in which these dependencies can arise are illustrated and it is shown how these dependencies may invalidate the use of analysis of variance (ANOVA) and its extension, trend analysis, as methods of evaluating the data of…

This manual is a first effort to begin to identify, describe, and develop procedures for assessing various aspects of digital reference service. Its overall purpose is to improve the quality of digital reference services and assist librarians to design and implement better digital reference services. More specifically, its aim is to: assist…

This paper discusses the determination of college faculty salary inequity and identifies the areas in which human judgment must be used in order to conduct a statistical analysis of salary equity. In addition, it provides some informed guidelines for making those judgments. The paper provides a framework for selecting salary equity models, based…

COMPUTER PROGRAMS AND OPERATING INSTRUCTIONS WERE REPORTED FOR USE IN PROCESSING DATA ON TEACHER ROLES. INCLUDED IN THE OVERALL DATA-PROCESSING METHOD WERE--(1) A PROGRAM FOR TABULATING CONTINGENCY TABLES FROM DATA ON PUNCHED CARDS, (2) A PROGRAM FOR SELECTING AND COMBINING ROWS AND CALCULATING MANN-WHITNEY MEASURES OF SIGNIFICANT DIFFERENCES…

To appeal to a larger student base, institutions have utilized current online technologies to provide courses to those students who would not otherwise be served. Unfortunately, the online learning experience has not been a positive one for a substantial portion of participating students. Thus, a key issue for postsecondary institutions is that of…

This paper reports the results of a Monte Carlo investigation of Type I errors in the single group repeated measures design where multiple measures are collected from each observational unit at each measurement occasion. The Type I error of three multivariate tests were examined. These were the doubly multivariate F test, the multivariate mixed…

Unlike the past models guiding cross-cultural psychological research, a new paradigm facilitates multiple level investigations by incorporating both culture-specific (nested) and culture-general (crossed) independent variables within its partially-hierarchical framework. Based upon the generalizability analysis, this model generates sequential…

The VARAN (variance Analysis) program is an addition to a series of computer programs for multivariate analysis of variance. The development of VARAN exploits the full linear model. Analysis of variance, univariate and multivariate, is the program's main target. Correlation analysis of all types is available with printout in the vernacular of…

Alternative ways of analyzing data from Aptitude Treatment Interactions were examined over a two-year period. In light of past arguments the author maintains that the questions surrounding aggregation have been badly posed and that the customary methods of analysis were either incorrect or subject to misinterpretation. Therefore, the majority of…

Outlines the simple exercise of measuring the length of an object as a concrete paradigm of the entire process of making chemical measurements and treating the resulting data. Discusses the procedure, significant figures, measurement error, spurious data, rejection of results, precision and accuracy, and student responses. (TW)

A random sample of 113 members of the American Vocational Education Research Association (AVERA) was surveyed to obtain baseline information regarding AVERA members' perceptions of statistical significance tests. The Psychometrics Group Instrument was used to collect data from participants. Of those surveyed, 67% were male, 93% had earned a…

The aim of this study was to incorporate a web-assisted program to normal traditional classroom instruction and study about students' misconceptions in force and motion concepts in physics. The Web-based physics program was incorporated with the traditional lecture. Specifically, 30% of class time was allocated for using this tutorial program, and…

Although methodological integrity is not the sole determinant of the value of a program evaluation, decision-makers do have a right, at a minimum, to be able to expect competent work from evaluators. This paper explores five areas where evaluators might improve methodological practices. First, evaluation reports should reflect the limited…

Data drawn from 30 journal articles and ERIC documents reporting on gender differences in natural science achievement were re-examined. Three meta-analysis methods were used: (1) vote counts and vote-counting estimation procedures; (2) tests of combined significance; and (3) analyses of effect sizes. The three methods produced seemingly…