Multilevel modeling (MLM) is a statistical technique for analyzing clustered data. Despite its long history, the technique and accompanying computer programs are rapidly evolving. Given the complexity of multilevel models, it is crucial for researchers to provide complete and transparent descriptions of the data, statistical analyses, and results.…

Ensuring internal validity in quantitative research requires, among other conditions, reliable instrumentation. Unfortunately, however, second language (L2) researchers often fail to report and even more often fail to interpret reliability estimates beyond generic benchmarks for acceptability. As a means to guide interpretations of such estimates,…

Despite increases in the number of articles published in higher education journals using structural equation modelling (SEM), research addressing their statistical sufficiency, methodological appropriateness and quantitative rigour is sparse. In response, this article provides a census of all covariance-based SEM articles published up until 2013…

A common question asked by researchers using regression models is, What sample size is needed for my study? While there are formulae to estimate sample sizes, their assumptions are often not met in the collected data. A more realistic approach to sample size determination requires more information such as the model of interest, strength of the…

It is widely known that there is a dearth of education research in South Africa which takes as its methodological basis experimentation. The emphasis has been on educators' and learners' experiential understanding in the first decade of democracy after apartheid, when qualitative research predominated. The article investigates, first, the extent…

Methodological barriers have been highlighted as a primary reason for the limited research with lesbian, gay, and bisexual (LGB) people of color. Thus, strategies for anticipating and addressing potential methodological barriers are needed. To address this need, this article discusses potential challenges associated with conducting research with…

This study examines two journals specific to the middles grades where original quantitative empirical articles are published, Research in Middle Level Education and Middle Grades Research Journal to determine what quantitative statistics are used, how they are used, and what study designs are used. Important for those who write for the…

The authors of this article examine the analytic and reporting features of research articles cited in "Studying Teacher Education: The Report of the AERA Panel on Research and Teacher Education" (Cochran-Smith & Zeichner, 2005b) that used quantitative reporting practices. Their purpose was to help to identify reporting practices that can be…

When one wants to set data reliability standards for a class of scientific inquiries or when one needs to compare and select among many different kinds of data with reliabilities that are crucial to a particular research undertaking, then one needs a single reliability coefficient that is adaptable to all or most situations. Work toward this goal…

The stability of bias estimates from J. Schueneman's chi-square method, the transformed Delta method, Rasch's one-parameter residual analysis, and the Mantel-Haenszel procedure, were compared across small and large samples for a data set of 30,000 cases. Bias values for 30 samples were estimated for each method, and means and variances of item…

The 1988 National Survey of Postsecondary Faculty (NSOPF-88), later named the National Study of Postsecondary Faculty, was the first comprehensive study of higher education instructional faculty conducted by the National Center for Education Statistics since 1963. This report provides a description of the 1993 NSOPF and the data generated by its…

The Walsh and Carballo evaluation of the effectiveness of transitional bilingual education programs in five Massachusetts communities, has the following flaws: (1) the sample of school districts studied suffered from "self-selection bias"; (2) the sample does not include a single large, urban school district; (3) the student samples…

The use of meta-analysis in industrial and organizational psychology has become quite common. Unfortunately, the understanding and research necessary to ensure appropriate application of the technique have not been as widespread. As part of a larger study, a content analysis of meta-analyses from the industrial and organizational psychological…

The central purpose of the present study was to evaluate several statistical techniques (analysis of variance (ANOVA) on raw gains, standardized ANOVA, standard analysis of covariance (ANCOVA), and z-score ANOVA) under various quasi-experimental conditions (three levels of reliability, three levels of sample size, three levels of gain, and the…

This manual provides guidance and documentation for users of the 1993 National Study of Postsecondary Faculty (NSOPF-93) restricted-use data files and of the public-use institution data file. The NSOPF-93 was the successor to a 1988 study of postsecondary faculty. Information about the purpose of the study, the data collection instruments, the…