Background/Context: Confirmatory factor analysis (CFA) model is a commonly adopted framework to estimate and test a measurement model. Once a well-fitting final CFA model is selected, the selected model may be used to test structural relationships of the latent constructs with other variables, to construct a test with desired reliability and…

Small sample sizes contribute to several problems in research and knowledge advancement. This conceptual replication study confirmed and extended the inflation of type II errors and confidence intervals in correlation analyses of small sample sizes common in kinesiology/exercise science. Current population data (N = 18, 230, & 464) on four…

The COVID-19 pandemic touched off an unprecedented search for vaccines and treatments. Without question, the development of vaccines to prevent COVID-19 was an enormous scientific accomplishment. Further, the RECOVERY and Solidarity trials identified effective treatments for COVID-19. But all was not success. The urgent need for COVID-19…

Since 2018, colleagues from two research centers at Dublin City University have been collaborating to develop a measurement scale to assess individuals' ability to identify workplace bullying. Having agreed on an operational definition of the construct, an item pool of 26 workplace bullying scenarios, that is, short descriptions of…

In undergraduate research settings, students are likely to encounter anomalous data, that is, data that do not meet their expectations. Most of the research that directly or indirectly captures the role of anomalous data in research settings uses post-hoc reflective interviews or surveys. These data collection approaches focus on recall of past…

Test-retest reliability assessments rarely investigate whether reliability itself is stable or change in reliability affects findings from substantive models. Research across the social sciences often recognizes that measurement error could influence results, yet it rarely applies established error correction methods. Focusing on gender wage…

We revisit the merits of the retrospective pretest-posttest (RPP) design for repeated-measures research. The underutilized RPP method asks respondents to rate survey items twice during the same posttest measurement occasion from two specific frames of reference: "now" and "then." Individuals first report their current attitudes…

Teachers' beliefs towards educational research has become one significant factor in explaining the gap between research and practice. The present study aimed at reviewing the scale to measure teachers' beliefs about the causes and problems related to research-based practices, describing beliefs that teachers appear to hold, and examining its…

Critically examining common statistical approaches and their strengths and weaknesses is an important step in advancing recreation and leisure sciences. To continue this critical examination and to inform methodological decision making, this study compared three approaches to determine how alternative approaches may result in contradictory…

This study explored motivation and engagement among North American (the United States and Canada; n = 1,540), U.K. (n = 1,558), Australian (n = 2,283), and Chinese (n = 3,753) secondary school students. Motivation and engagement were assessed via students' responses to the Motivation and Engagement Scale-High School (MES-HS). Confirmatory factor…

The growing importance of genomics and bioinformatics methods and paradigms in biology has been accompanied by an explosion of new curricula and pedagogies. An important question to ask about these educational innovations is whether they are having a meaningful impact on students' knowledge, attitudes, or skills. Although assessments are…

The reliability of differences between pretest and posttest measures with intervening experimental treatment can be highly reliable under some conditions. If the error components of pretest and posttest measures are correlated, the classical formula for the reliability of differences underestimates the actual reliability of gains. (Author/CM)

This paper presents three different ways of computing the internal consistency coefficient alpha for a same set of data. The main objective of the paper is the illustration of a method for maximizing coefficient alpha. The maximization of alpha can be achieved with the aid of a principal component analysis. The relation between alpha max. and the…

Investigates the use of "vague quantifiers" (terms such as "often,""sometimes,""rarely," or "never") in communication research. Finds that these words do not always mean the same thing to different people, and thus may not constitute interval scales. Suggests that research outcomes based upon such…

How is the usefulness of research assessed as university research becomes more and more commodified? The question is addressed through an analysis of how the results of a particular research project were received in a large private company that had provided the main funding for a research project on gender and top management, a project based on…