This paper examines how various equating methods are affected by: (1) sampling error; (2) sample characteristics; and (3) characteristics of anchor test items. It reviews empirical studies that investigated the invariance of equating transformations, and it discusses empirical and simulation studies that focus on how the properties of anchor tests…

Statistical significance is misused in educational and psychological research when it is applied as a method to establish the reliability of research results. Other techniques have been developed which can be correctly utilized to establish the generalizability of findings. Methods that do provide such estimates are known as invariance or…

The present study, using a sample of 1,491 grade 10 students from a mid-western province in Canada, examined the validity evidence on the Canadian Tests of Basic Skills. Factor analysis of the 34 micro-skills (content by skill/process classification of items) of the four tests indicated that the Reading Comprehension, Written Expression, and Using…

This study investigated seven methods for analyzing multivariate group differences. Bonferroni t statistics, multivariate analysis of variance (MANOVA) followed by analysis of variance (ANOVA), and five other methods were studied using Monte Carlo methods. Methods were compared with respect to (1) experimentwise error rate; (2) power; (3) number…

An efficiency study was conducted of the base year design used for the National Longitudinal Study of the High School Class of 1972 (NLS). Finding the optimal design involved a search for the numbers of sample schools and students that would maximize the variance at a given cost. Twenty-one variables describing students' plans, attitudes,…

Two aspects of criterion referenced testing are discussed: cutting scores and test length. Several practices in determining passing scores are enumerated: (1) setting passing scores so that a predetermined percent of students pass; (2) inspecting each test item to determine how important it is that it be answered correctly; (3) determining the…

The No Child Left Behind Act (P.L. 107-110) called for the U.S. Department of Education to carry out a national study of the effectiveness of educational technology. With computers becoming ubiquitous in American schools, and purchases of hardware and software now substantial expenses for school districts, whether funding is supporting effective…

This article reviews experimental studies comparing bilingual and English-only reading programs for English language learners. The review method is best-evidence synthesis, which uses a systematic literature search, quantification of outcomes as effect sizes, and extensive discussion of individual studies that meet inclusion standards. A total of…

Legislative mandates in California and at the federal level require written parental consent for surveys of children and youth on: sexual behavior and attitudes; illegal, antisocial and criminal behavior; and psychological problems. Active parental refusal and nonresponse to requests for permission threaten the generalizability of information…

A multi-year program, Project Homeroom, designed to introduce home-based computing to a select group of high school teachers, students, and their parents was recently conducted in three Chicago-area (Illinois) schools. The Technological Innovations in Educational Research Laboratory at Illinois State University (Normal) evaluated this program.…

The nine-volume Survey Kit is designed to help readers prepare and conduct surveys and become better users of survey results. All the books in the series contain instructional objectives, exercises and answers, examples of surveys in use, illustrations of survey questions, guidelines for action, checklists of "dos and don'ts," and…

This paper studies statistical procedures used in the "Journal of Research in Music Education" (JRME) over a 5-year period (1987 through 1991). The results are compared with those of L. D. Goodwin and W. L. Goodwin (1985) concerning the "American Educational Research Journal" for the same period. In all, 78 quantitative and 31…

This paper demonstrates the relationship between the concept of unidimensionality and direction of an item in a multidimensional space. The basic premise is that if items that measure in the same direction are combined to form a test, that test will meet the item response theory requirements of unidimensionality. This will be true even if the…

Appraisal of a school's relative effectiveness is complicated by: (1) the need to control for input differences; (2) measurement error in input measures; and (3) small sample size within schools. This study compares the performance of two successive cohorts in 19 schools in a small midwestern city on the five Iowa Tests of Basic Skills using both…

An efficiency study was conducted of the sampling design used for the National Longitudinal Study of the High School Class of 1972 (NLS), and the change variables used in the first followup. Nine alternative designs were compared, using a cost model based upon the number of schools and students sampled. Fourteen change variables and eight domains…