The purpose of this study is to investigate association of data collectors' differences with the differences in reliability and validity of scores regarding affective variables (motivation toward science learning and science attitude) that are measured by Likert-type scales. Four researchers trained in data collection and seven science teachers…

We surveyed researchers in the health and exercise sciences to explore different areas and magnitudes of bias in researchers' decision making. Participants were presented with scenarios (testing a central hypothesis with p = 0.06 or p = 0.04) in a random order and surveyed about what they would do in each scenario. Participants showed significant…

Agricultural education teachers' attitudes about the perceptions of diversity inclusion in their programs are variables that may have a strong influence on the number of students that enroll in agricultural education. This study examines the effect of teachers' demographic and personal characteristics on their perceptions of the benefits of…

Assessing the comparability of different groups is an issue facing many researchers and evaluators in a variety of settings. Commonly, null hypothesis significance testing (NHST) is incorrectly used to demonstrate comparability when a non-significant result is found. This is problematic because a failure to find a difference between groups is not…

This methodological brief introduces the readers to the propensity score matching method, which can be used for enhancing the validity of causal inferences in research situations involving nonexperimental design or observational research, or in situations where the benefits of an experimental design are not fully realized because of reasons beyond…

The purpose of this study was to determine if professional development using school contextual data would provide deeper understanding and attention to the important issue of student bullying. This was primarily a quantitative study. Phase 1 involved using data from the pre-existing student and teacher needs assessments to create the school…

In this study, the researcher investigated whether the degree of communication apprehension reported by college freshmen who have been homeschooled differs significantly from that reported by their peers with more traditional high school backgrounds. Inspired by the researcher's college classroom experiences, the study provided insights into the…

Previous work on statistical power has discussed mainly single-level designs or 2-level balanced designs with random effects. Although balanced experiments are common, in practice balance cannot always be achieved. Work on class size is one example of unbalanced designs. This study provides methods for power analysis in 2-level unbalanced designs…

Objective: This research was conducted to determine if relationships exist among college students' business email message productivity score and (a) email message quality score, (b) text keying method used to create email message, and (c) self-reported college English grade. Background: Email is increasingly the communication channel preferred for…

Correlation matrices and standard deviations are the building blocks of many of the commonly conducted analyses in published research, and AERA and APA reporting standards recommend their inclusion when reporting research results. The authors argue that the inclusion of correlation/covariance matrices, standard deviations, and means can enhance…

This investigation reports on the cross-cultural equivalence testing of the Self-Description Questionnaire II (short version; SDQII-S) for Indigenous and non-Indigenous Australian secondary student samples. A variety of statistical analysis techniques were employed to assess the psychometric properties of the SDQII-S for both the Indigenous and…

Many composition teachers use the writing conference to provide feedback to their students; however, the existing literature on the subject indicates that teachers may unintentionally harm their weaker students by using this strategy. To better understand the effect of the writing conference on developmental writing students, the researcher…

Controversy over the proper place of significance testing within scientific methodology has continued for some time. The suggestion that effect sizes are more important than whether results are significant is presented. Effect size can be defined as an estimate of how much of the dependent variable is accounted for by the independent variables.…

In response to the increasing call by professional organizations, journal editors, and statisticians to include not only derived significance levels from quantitative statistical procedures but also measures of effect sizes (ES), this article first provides a rationale for school counseling-related researchers to include these key indices in their…

A random sample of 113 members of the American Vocational Education Research Association (AVERA) was surveyed to obtain baseline information regarding AVERA members' perceptions of statistical significance tests. The Psychometrics Group Instrument was used to collect data from participants. Of those surveyed, 67% were male, 93% had earned a…