Previous research extensively studied reasons for and ways to avoid low response rates, but it largely ignored the primary research issue of the degree to which response rates matter, which we address. Methodological survey research on response rates has been concerned with how to increase responsiveness and with the effects of response rates on…

Purpose: The lack of a definite standard for determining the sample size in qualitative research leaves the research process to the initiative of the researcher, and this situation overshadows the scientificity of the research. The primary purpose of this research is to propose a model by questioning the problem of determining the sample size,…

This paper evaluates the use of Factor Analysis (FA) in English education research in Korea and suggests improvements in methodology. A detailed coding protocol was used to review 179 FA cases from 12 major English education journals (2014-2023). The review identified several key issues, including small sample sizes and lenient criteria for sample…

Background: Over the past decade, research on the development and assessment of tools to improve the generalizability of experimental findings has grown extensively (Tipton & Olsen, 2018). However, many experimental studies in education are based on small samples, which may include 30-70 schools while inference populations to which…

This investigation examines the efficacy of multilevel analysis of individual heterogeneity and discriminatory accuracy (MAIHDA) over fixed-effects models when performing intersectional studies. The research questions are as follows: (1) What are typical strata representation rates and outcomes on physics research-based assessments? (2) To what…

The use of structural equation modeling (SEM) techniques in social work has increased over the last two decades. We therefore conducted a systematic review to understand the extent to which SEM is utilized in social work research, given that statistical training is now becoming a part of social work doctoral education. For our review, we utilized…

Multilevel modeling (MLM) is a statistical technique for analyzing clustered data. Despite its long history, the technique and accompanying computer programs are rapidly evolving. Given the complexity of multilevel models, it is crucial for researchers to provide complete and transparent descriptions of the data, statistical analyses, and results.…

There has been considerable recent interest in methods of determining sample size for qualitative research a priori, rather than through an adaptive approach such as saturation. Extending previous literature in this area, we identify four distinct approaches to determining sample size in this way: rules of thumb, conceptual models, numerical…

In his detailed response to our paper on sample size in qualitative research, Norman Blaikie raises important issues concerning conceptual definitions and taxonomy. In particular, he points out the problems associated with a loose, generic application of adjectives such as 'qualitative' or 'inductive'. We endorse this concern, though we suggest…

Multivariate analysis of variance (MANOVA) is a statistical method used to examine group differences on multiple outcomes. This article reports results of a review of MANOVA in gifted education journals between 2011 and 2017 (N = 56). Findings suggest a number of conceptual and procedural misunderstandings about the nature of MANOVA and its…

In education research, small samples are common because of financial limitations, logistical challenges, or exploratory studies. With small samples, statistical principles on which researchers rely do not hold, leading to trust issues with model estimates and possible replication issues when scaling up. Researchers are generally aware of such…

The purpose of this study was to analyze and compare recent research papers on foreign language education in Turkish context with those published in international context to shed light on researchers and policy makers for future studies. This study filled a gap in this field and also aimed to increase the rate of acceptance of research papers…

Research in fields other than education has found that studies with small sample sizes tend to have larger effect sizes than those with large samples. This article examines the relationship between sample size and effect size in education. It analyzes data from 185 studies of elementary and secondary mathematics programs that met the standards of…

The normative implications of applying significance tests in evaluation research are examined. The authors conclude that evaluators often make normative decisions, based on the traditional .05 significance level in studies with small samples. Additional reporting of the magnitude of impact, the significance level, and the power of the test is…

Suggest practical procedure for estimating number of subjects that need to be screened to obtain sample of fixed size that meets multiple correlated criteria. Procedure described is based on fact that least-squares regression provides good quadratic fit for Monte Carlo estimates of multivariate probabilities when they are plotted as function of…