There has been considerable recent interest in methods of determining sample size for qualitative research a priori, rather than through an adaptive approach such as saturation. Extending previous literature in this area, we identify four distinct approaches to determining sample size in this way: rules of thumb, conceptual models, numerical…

When a psychologist announces a new research finding, it is often based on a rejected null hypothesis. However, if that hypothesis is true, the claim is a false alarm. Many students mistakenly believe that the probability of committing a false alarm equals alpha, the criterion for statistical significance, which is typically set at 5%. Instructors…

Scholars increasingly rely on indirect questioning techniques to reduce social desirability bias and item nonresponse for sensitive survey questions. The major drawback of these approaches, however, is their inefficiency relative to direct questioning. We show how to improve the statistical analysis of the list experiment, randomized response…

This paper discusses some of the recurrent issues which the authors have noticed in educational research. These might be concerned with the nature of social science research, such as its representation of the reality of student learning, the role for replication studies, and the tolerance for disagreements. There are also issues related to the…

This paper discusses some of the recurrent issues which the authors have noticed in educational research. These might be concerned with the nature of social science research, such as its representation of the reality of student learning, the role for replication studies, and the tolerance for disagreements. There are also issues related to the…

The purposes of this manuscript are to identify common statistical mistakes in sport management, and to provide scholars with suggestions on how to develop and improve the quality of quantitative research. We have reviewed articles published from 2001 to 2017 in the "Journal of Sport Management," "Sport Management Review,"…

Sport management research has evolved significantly despite its relatively short history as an academic discipline. Although the pace of scholarly progress has been impressive, the extent to which many research efforts have aided sport management in becoming a distinct academic discipline is, at times, questionable. A major challenge many scholars…

The use of advanced quantitative methods within mixed methods research has been investigated in a limited capacity. In particular, hierarchical linear models are a popular approach to account for multilevel data, such as students within schools, but its use and value as the quantitative strand in a mixed methods study remains unknown. This article…

Multivariate techniques are increasingly popular as researchers attempt to accurately model a complex world. MANOVA is a multivariate technique used to investigate the dimensions along which groups differ, and how these dimensions may be used to predict group membership. A concern in a MANOVA analysis is to determine if a smaller subset of…

While other fields such as statistics and education have examined various issues with quantitative work, few studies in physics education research (PER) have done so. We conducted a two-phase study to identify and to understand the extent of these issues in quantitative PER. During phase 1, we conducted a focus group of three experts in this area,…

An advantage of well-designed survey research is that, typically, it yields large volumes of quantitative and qualitative data. A key challenge researchers face is mining and reporting these data appropriately and promptly to inform research publications and presentations. When mixed methods are employed, and researchers attempt to master computer…

In this commentary from Issue 14, n3, authors John Cadogan and Nick Lee applaud the paper by Aguirre-Urreta, Rönkkö, and Marakas "Measurement: Interdisciplinary Research and Perspectives", 14(3), 75-97 (2016), since their explanations and simulations work toward demystifying causal indicator models, which are often used by scholars…

This report presents a review of the statistical practices of 30 journals representative of the second language field. A review of 150 articles showed a number of prevalent statistical violations including incomplete reporting of reliability, validity, non-significant results, effect sizes, and assumption checks as well as making inferences from…

Measuring race and ethnicity for administrative data sets and then analyzing these data to understand racial/ethnic disparities present many logistical and theoretical challenges. In this chapter, we conduct a synthetic review of studies on how to effectively measure race/ethnicity for administrative data purposes and then utilize these measures…

Purpose of the Study: Missing data are a common problem encountered while implementing measurement instruments. Yet the extent to which reliability, validity, average discrimination and difficulty of the test results are affected by the missing data has not been studied much. Since it is inevitable that missing data have an impact on the…