Criteria are briefly proposed for final conclusions, research problems, and research hypotheses in quantitative research. Moreover, based on a proposed definition of applied and basic/general research, it is argued that (1) in applied quantitative research, while research problems are necessary, research hypotheses are unjustified, and that (2) in…

Missing data is a common challenge to any researcher in almost any field of research. In particular, human participants in research do not always respond or return for assessments leaving the researcher to rely on missing data methods. The most common methods (i.e., Multiple Imputation and Full Information Maximum Likelihood) assume that the…

Refutation texts, rhetorical tools designed to reduce misconceptions, have garnered attention across four decades and many studies. Yet, the ability of a refutation text to change a learner's mind on a topic needs to be qualified and modulated. In this critical review, we bring attention to sources of constraints often overlooked by refutation…

We revisit the merits of the retrospective pretest-posttest (RPP) design for repeated-measures research. The underutilized RPP method asks respondents to rate survey items twice during the same posttest measurement occasion from two specific frames of reference: "now" and "then." Individuals first report their current attitudes…

In experimental research, internal validity refers to what extent researchers can conclude that changes in dependent variable (i.e. outcome) are caused by manipulations in independent variable. The causal inference permits researchers to meaningfully interpret research results. This article discusses (a) internal validity threats in social and…

Regression discontinuity design (RD) has been widely used to produce reliable causal estimates. Researchers have validated the accuracy of RD design using within study comparisons (Cook, Shadish & Wong, 2008; Cook & Steiner, 2010; Shadish et al, 2011). Within study comparisons examines the validity of a quasi-experiment by comparing its…

This article presents a reflection on an aspect of research methodology, particularly on the interpretation strategy of data from a Science and Indigenous Knowledge Systems Project (SIKSP) in a South African university. The data interpretation problem arose while we were analysing the effects of a series of SIKSP-based workshops on the views of a…

The sharp regression discontinuity design (RDD) has three key weaknesses compared to the randomized clinical trial (RCT). It has lower statistical power, it is more dependent on statistical modeling assumptions, and its treatment effect estimates are limited to the narrow subpopulation of cases immediately around the cutoff, which is rarely of…

A meta-analysis by Tran, Sanchez, Arellano, and Swanson (2011) of the published RTI literature found that the magnitude of effect size (ES) between responders and low responders at posttest was significantly moderated by the pretest ES and the type of dependent measure administered, whereas no significant moderating effects were found in the mixed…

The study evaluates a semester-long workbook curriculum approach to teaching a college level introductory statistics course. The workbook curriculum required students to read content before and during class and then work in groups to complete problems and answer conceptual questions pertaining to the material they read. Instructors spent class…

Because of the Flynn effect, IQ scores rise as a test norm ages but drop on the introduction of a newly revised test norm. The purpose of the current study was to determine the impact of the Flynn effect on learning disability (LD) diagnoses, the most prevalent special education diagnosis in the United States. Using a longitudinal sample of 875…

In this chapter, the authors discuss the issue of research design in conducting inquiry on college impact and demonstrate the importance of longitudinal pretest-posttest designs in maximizing the internal validity of findings. They begin by discussing the strengths and weaknesses of different types of research design in the college impact…

The purpose of this study was to determine the effects of interactive multimedia simulations and virtual dissection software on depth of learning among students participating in biology and chemistry laboratory courses. By understanding more about how simulation and virtual dissection software changes depth of learning, educators will have the…

The validity of true experiments is threatened by a class of self-report biases that affect all respondents at pretest, but which are diminished by treatment. Four of these inaccurate self-evaluation biases are discussed. Means of detection include external criteria, special conditions of measurement, and retrospective pretests. (TJH)

This study presents the circuitous route taken in an attempt to identify an assessment mechanism for evaluating the impact of STS courses. After initially developing a survey that faculty felt only allowed for the measurement of student opinions about the impact of required STS general education courses, the faculty at Clemson University…