Background: Most of the studies in academic journals use p values to represent statistical significance. However, this is not a good indicator of practical significance. Although confidence intervals provide information about the precision of point estimation, they are, unfortunately, rarely used. The infrequent use of confidence intervals might…

The purpose of this study is to investigate association of data collectors' differences with the differences in reliability and validity of scores regarding affective variables (motivation toward science learning and science attitude) that are measured by Likert-type scales. Four researchers trained in data collection and seven science teachers…

Introduction: We report an investigation on collaboration practices in research papers published in the most prestigious English-medium astrophysics journals. Method: We propose an evaluation method based on three numerical indicators to study and compare, in absolute terms, three different types of collaboration (international, national and…

Researchers are strongly encouraged to accompany the results of statistical tests with appropriate estimates of effect size. For 2-group comparisons, a probability-based effect size estimator ("A") has many appealing properties (e.g., it is easy to understand, robust to violations of parametric assumptions, insensitive to outliers). We review…

We surveyed researchers in the health and exercise sciences to explore different areas and magnitudes of bias in researchers' decision making. Participants were presented with scenarios (testing a central hypothesis with p = 0.06 or p = 0.04) in a random order and surveyed about what they would do in each scenario. Participants showed significant…

The motivation for this paper is the authors' recent work on several randomized control trials in which they found the primary result, which averaged across subgroups or sites, to be moderated by demographic or site characteristics. They are led to examine a distinction that the Institute of Education Sciences (IES) makes between "confirmatory"…

This empirical research investigates subscription price variations of scholarly journals in five business subject-specific areas using the semilogarithmic regression model. It has two main purposes. The first is to address the unsettled debate over whether or not and to what extent commercial publishers reap monopoly profits by overcharging…

The empirical study we present here deals with a pedagogical issue that has not been thoroughly explored up until now in our field. Previous empirical studies in other sectors have identified the opinions of researchers about this topic, showing that completely unacceptable interpretations have been made of significance tests and other statistical…

This paper is directed to researchers who conduct and report education intervention studies. Its purpose is to stimulate and guide them to go a step beyond reporting the statistics that emerge from their analysis of the differences between experimental groups on the respective outcome variables. With what is often very minimal additional effort,…

As schools turn to data-driven decision making to improve student achievement, research is playing an increasingly important role in local policy making. Researchers have worked to help policy makers better "understand" research with a focus on research design and method. How to better "use" research, however, has received little attention. This…

There have been many discussions of how Type I errors should be controlled when many hypotheses are tested (e.g., all possible comparisons of means, correlations, proportions, the coefficients in hierarchical models, etc.). By and large, researchers have adopted familywise (FWER) control, though this practice certainly is not universal. Familywise…

This paper includes a nontechnical description of methods for calculating effect sizes in intellectual and developmental disability studies. Different hypothetical studies are used to illustrate how null hypothesis significance testing (NHST) and effect size findings can result in quite different outcomes and therefore conflicting results. Whereas…

Agricultural education teachers' attitudes about the perceptions of diversity inclusion in their programs are variables that may have a strong influence on the number of students that enroll in agricultural education. This study examines the effect of teachers' demographic and personal characteristics on their perceptions of the benefits of…

The widespread popularity of programs for first-year students is due, in large part, to studies showing that participation in first-year programs is significantly related to students' academic success. Because students choose to participate in first-year programs, self-selection effects prevent researchers from making causal claims about the…

This study investigated the effect School-Wide Positive Behavior Support had on special education students' achievement and office discipline referrals. Sixty-nine special education students from eight elementary schools participated in this study. Thirty-four participants were in the group with School-Wide Positive Behavior Support, and 35…